[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:15 dist-test-slave-fbl4 krb5kdc[12876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:15 dist-test-slave-fbl4 krb5kdc[12876](info): set up 2 sockets
Jun 19 02:44:15 dist-test-slave-fbl4 krb5kdc[12876](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260619 02:44:15.990484 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:16.103385 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:43903
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:43903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:16.181293 12889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:16.181529 12889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:16.181563 12889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:16.182735 12889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:16.182799 12889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:16.182823 12889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:16.182857 12889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:16.182883 12889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:16.184365 12889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:43903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:43903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:16.184634 12889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:16.184860 12889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 02:44:16.190057 12889 server_base.cc:1034] running on GCE node
W20260619 02:44:16.190084 12895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.190091 12897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.190203 12894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:16.190588 12889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:16.190872 12889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:16.192010 12889 hybrid_clock.cc:648] HybridClock initialized: now 1781837056191997 us; error 29 us; skew 500 ppm
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:16.197091 12889 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:16.197513 12889 webserver.cc:460] Webserver started at http://127.12.145.126:34887/ using document root <none> and password file <none>
I20260619 02:44:16.197757 12889 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:16.197801 12889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:16.197964 12889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:16.199071 12889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "f1e94045c8d94ad484d819862fe7e926"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "2f9bf0c02de48b1ba8bb28b4c673aeaa"
server_key_iv: "540237d719e1e88a7e4bf8fa506392f9"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.199429 12889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "f1e94045c8d94ad484d819862fe7e926"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "2f9bf0c02de48b1ba8bb28b4c673aeaa"
server_key_iv: "540237d719e1e88a7e4bf8fa506392f9"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.200752 12889 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:16.201439 12904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.201601 12889 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:16.201697 12889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "f1e94045c8d94ad484d819862fe7e926"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "2f9bf0c02de48b1ba8bb28b4c673aeaa"
server_key_iv: "540237d719e1e88a7e4bf8fa506392f9"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.201786 12889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:16.224097 12889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:16.225955 12889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:16.226119 12889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:16.229947 12889 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:43903
I20260619 02:44:16.230003 12956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:43903 every 8 connection(s)
I20260619 02:44:16.230360 12889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:16.231207 12957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:16.233373 12957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926: Bootstrap starting.
I20260619 02:44:16.233927 12957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:16.234207 12957 log.cc:824] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:16.234957 12957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926: No bootstrap required, opened a new log
I20260619 02:44:16.236474 12957 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e94045c8d94ad484d819862fe7e926" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43903 } }
I20260619 02:44:16.236603 12957 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:16.236625 12957 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e94045c8d94ad484d819862fe7e926, State: Initialized, Role: FOLLOWER
I20260619 02:44:16.236793 12957 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e94045c8d94ad484d819862fe7e926" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43903 } }
I20260619 02:44:16.236883 12957 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:16.236936 12957 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:16.236991 12957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:16.237496 12957 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e94045c8d94ad484d819862fe7e926" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43903 } }
I20260619 02:44:16.237632 12957 leader_election.cc:302] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1e94045c8d94ad484d819862fe7e926; no voters:
I20260619 02:44:16.237821 12957 leader_election.cc:288] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:16.237854 12960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:16.237931 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 12889
I20260619 02:44:16.237969 12960 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [term 1 LEADER]: Becoming Leader. State: Replica: f1e94045c8d94ad484d819862fe7e926, State: Running, Role: LEADER
I20260619 02:44:16.238037 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:16.238070 12957 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:16.238045 12960 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e94045c8d94ad484d819862fe7e926" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43903 } }
I20260619 02:44:16.238360 12960 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e94045c8d94ad484d819862fe7e926. Latest consensus state: current_term: 1 leader_uuid: "f1e94045c8d94ad484d819862fe7e926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e94045c8d94ad484d819862fe7e926" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43903 } } }
I20260619 02:44:16.238412 12960 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:16.238734 12962 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1e94045c8d94ad484d819862fe7e926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e94045c8d94ad484d819862fe7e926" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43903 } } }
I20260619 02:44:16.238816 12962 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:16.238819 12869 external_mini_cluster.cc:1428] Setting key 05b1daea07cea1318291029eec598480
I20260619 02:44:16.239571 12964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:16.240073 12964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:16.241578 12964 catalog_manager.cc:1347] Generated new cluster ID: e9fee2f0c06647e393cc2cc895656ccf
I20260619 02:44:16.241631 12964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:16.248045 12964 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:16.248755 12964 catalog_manager.cc:1504] Loading token signing keys...
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:16.254204 12975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.239659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54018 (local address 127.12.145.126:43903)
0619 02:44:16.239844 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:16.239855 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:16.242187 (+ 2332us) server_negotiation.cc:407] Connection header received
0619 02:44:16.242268 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:16.242272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:16.242320 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:16.242445 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:16.243899 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.244821 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.245837 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.246235 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.246355 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.250388 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:16.250392 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:16.250392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:16.250403 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:16.252268 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.252757 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.252760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.252761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.252877 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.253168 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.253169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.253169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.253420 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:16.253545 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:16.253852 (+ 307us) server_negotiation.cc:299] Negotiation successful
0619 02:44:16.253986 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260619 02:44:16.264243 12964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1e94045c8d94ad484d819862fe7e926: Generated new TSK 0
I20260619 02:44:16.264417 12964 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:16.293227 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43903
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:16.372970 12983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:16.373165 12983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:16.373188 12983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:16.374315 12983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:16.374358 12983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:16.374409 12983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:16.375995 12983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43903
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:16.376243 12983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:16.376462 12983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:16.381261 12991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.381291 12989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.381296 12988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:16.381575 12983 server_base.cc:1034] running on GCE node
I20260619 02:44:16.381753 12983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:16.381930 12983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:16.383059 12983 hybrid_clock.cc:648] HybridClock initialized: now 1781837056383042 us; error 31 us; skew 500 ppm
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:16.385329 12983 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:16.385730 12983 webserver.cc:460] Webserver started at http://127.12.145.65:45821/ using document root <none> and password file <none>
I20260619 02:44:16.385982 12983 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:16.386049 12983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:16.386186 12983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:16.387208 12983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "6c031f5e87fc4750b1c7fbce0ed593bd"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "792eaf7c2512d38f121f32fdb15199de"
server_key_iv: "5cef3c7c4ce39e69a8872d48d2371bae"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.387498 12983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "6c031f5e87fc4750b1c7fbce0ed593bd"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "792eaf7c2512d38f121f32fdb15199de"
server_key_iv: "5cef3c7c4ce39e69a8872d48d2371bae"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.388835 12983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:16.389479 12998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.389669 12983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:16.389737 12983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "6c031f5e87fc4750b1c7fbce0ed593bd"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "792eaf7c2512d38f121f32fdb15199de"
server_key_iv: "5cef3c7c4ce39e69a8872d48d2371bae"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.389786 12983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:16.413750 12983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:16.415562 12983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:16.415669 12983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:16.415846 12983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:16.416157 12983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:16.416189 12983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.416241 12983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:16.416267 12983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.421902 12983 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:41223
I20260619 02:44:16.421952 13111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:41223 every 8 connection(s)
I20260619 02:44:16.422252 12983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:16.427773 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 12983
I20260619 02:44:16.427846 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:16.428011 12869 external_mini_cluster.cc:1428] Setting key 530485560f38f9a5383518d79b7bb3f4
I20260619 02:44:16.431165 12975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.422976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:48039 (local address 127.12.145.126:43903)
0619 02:44:16.423039 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:16.423041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:16.423225 (+ 184us) server_negotiation.cc:407] Connection header received
0619 02:44:16.423692 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:16.423693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:16.423702 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:16.423770 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:16.424659 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.425153 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.426072 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.426262 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.426311 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.428417 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:16.428419 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:16.428420 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:16.428427 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:16.429727 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.430150 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.430151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.430152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.430211 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.430478 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.430479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.430479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.430655 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:16.430729 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:16.430991 (+ 262us) server_negotiation.cc:299] Negotiation successful
0619 02:44:16.431079 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:44:16.431351 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.422917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:43903 (local address 127.12.145.65:48039)
0619 02:44:16.423104 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:16.423143 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:16.423613 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:16.423838 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:16.423841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:16.424399 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:16.424583 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:16.424587 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.425227 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.425228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:16.426001 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:16.426002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.426346 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.426347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:16.426444 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.426868 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:16.426876 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:16.428316 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:16.429810 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:16.429816 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:16.429819 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:16.430059 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:16.430281 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:16.430282 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:16.430282 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:16.430400 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:16.430719 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:16.430725 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:16.430861 (+ 136us) client_negotiation.cc:769] Sending connection context
0619 02:44:16.430969 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 02:44:16.431111 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260619 02:44:16.431813 13112 heartbeater.cc:347] Connected to a master server at 127.12.145.126:43903
I20260619 02:44:16.431910 13112 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:16.432096 13112 heartbeater.cc:511] Master 127.12.145.126:43903 requested a full tablet report, sending...
I20260619 02:44:16.432672 12921 ts_manager.cc:194] Registered new tserver with Master: 6c031f5e87fc4750b1c7fbce0ed593bd (127.12.145.65:41223)
I20260619 02:44:16.433642 12921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:48039
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:16.451282 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43903
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:16.529958 13117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:16.530140 13117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:16.530162 13117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:16.531280 13117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:16.531320 13117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:16.531347 13117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:16.532646 13117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43903
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:16.532823 13117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:16.532976 13117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:16.537762 13122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.537806 13123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.537761 13125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:16.537990 13117 server_base.cc:1034] running on GCE node
I20260619 02:44:16.538255 13117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:16.538529 13117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:16.539744 13117 hybrid_clock.cc:648] HybridClock initialized: now 1781837056539718 us; error 37 us; skew 500 ppm
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:16.542130 13117 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:16.542615 13117 webserver.cc:460] Webserver started at http://127.12.145.66:33851/ using document root <none> and password file <none>
I20260619 02:44:16.542851 13117 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:16.542918 13117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:16.543051 13117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:16.544055 13117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "8d359245c1f7404283321818cee31312"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "b3f95734ce5945d1326bcf2f25212023"
server_key_iv: "6c4960ee852cf1333ee0b0c01f8de636"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.544406 13117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "8d359245c1f7404283321818cee31312"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "b3f95734ce5945d1326bcf2f25212023"
server_key_iv: "6c4960ee852cf1333ee0b0c01f8de636"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.545670 13117 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:16.546397 13132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.546594 13117 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:16.546700 13117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "8d359245c1f7404283321818cee31312"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "b3f95734ce5945d1326bcf2f25212023"
server_key_iv: "6c4960ee852cf1333ee0b0c01f8de636"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.546783 13117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:16.571571 13117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:16.573589 13117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:16.573741 13117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:16.573964 13117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:16.574259 13117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:16.574290 13117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.574312 13117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:16.574326 13117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.580145 13117 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:43007
I20260619 02:44:16.580251 13245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:43007 every 8 connection(s)
I20260619 02:44:16.580562 13117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:16.585767 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 13117
I20260619 02:44:16.585870 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:16.586057 12869 external_mini_cluster.cc:1428] Setting key 99d37d1ee4736ffb1841e5050f0b0a09
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:16.590288 12975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.581269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:37603 (local address 127.12.145.126:43903)
0619 02:44:16.581313 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:16.581315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:16.581523 (+ 208us) server_negotiation.cc:407] Connection header received
0619 02:44:16.582073 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:16.582074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:16.582086 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:16.582145 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:16.583137 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.583669 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.584665 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.584866 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.584938 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.587370 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:16.587371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:16.587371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:16.587378 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:16.588996 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.589361 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.589362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.589362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.589412 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.589706 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.589707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.589707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.589812 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:16.589862 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:16.590165 (+ 303us) server_negotiation.cc:299] Negotiation successful
0619 02:44:16.590225 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:44:16.590626 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.581236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:43903 (local address 127.12.145.66:37603)
0619 02:44:16.581405 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:16.581440 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:16.581956 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:16.582212 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:16.582216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:16.582843 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:16.583019 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:16.583024 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.583763 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.583764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:16.584560 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:16.584562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.584942 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.584943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:16.585062 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.585509 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:16.585517 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:16.587260 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:16.589078 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:16.589083 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:16.589085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:16.589293 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:16.589507 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:16.589508 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:16.589508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:16.589642 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:16.589874 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:16.589879 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:16.590036 (+ 157us) client_negotiation.cc:769] Sending connection context
0619 02:44:16.590148 (+ 112us) client_negotiation.cc:240] Negotiation successful
0619 02:44:16.590331 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260619 02:44:16.591042 13246 heartbeater.cc:347] Connected to a master server at 127.12.145.126:43903
I20260619 02:44:16.591147 13246 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:16.591325 13246 heartbeater.cc:511] Master 127.12.145.126:43903 requested a full tablet report, sending...
I20260619 02:44:16.591745 12921 ts_manager.cc:194] Registered new tserver with Master: 8d359245c1f7404283321818cee31312 (127.12.145.66:43007)
I20260619 02:44:16.592325 12921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:37603
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:16.610771 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43903
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:16.689132 13251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:16.689320 13251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:16.689342 13251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:16.690389 13251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:16.690423 13251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:16.690448 13251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:16.691773 13251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43903
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:16.691960 13251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:16.692114 13251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:16.696715 13259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.696844 13256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:16.696766 13257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:16.696987 13251 server_base.cc:1034] running on GCE node
I20260619 02:44:16.697201 13251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:16.697386 13251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:16.698513 13251 hybrid_clock.cc:648] HybridClock initialized: now 1781837056698502 us; error 27 us; skew 500 ppm
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:16.700923 13251 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:16.701287 13251 webserver.cc:460] Webserver started at http://127.12.145.67:44089/ using document root <none> and password file <none>
I20260619 02:44:16.701530 13251 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:16.701577 13251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:16.701665 13251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:16.702762 13251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "32311fec5b3e4bd3b850b9d92e74346f"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "f9f9a6be09a18e10f4cc37999e049bd2"
server_key_iv: "7aef04b984c54c0589e206b70ea9b7b8"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.703053 13251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "32311fec5b3e4bd3b850b9d92e74346f"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "f9f9a6be09a18e10f4cc37999e049bd2"
server_key_iv: "7aef04b984c54c0589e206b70ea9b7b8"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.704303 13251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:16.705080 13266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.705263 13251 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:16.705359 13251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "32311fec5b3e4bd3b850b9d92e74346f"
format_stamp: "Formatted at 2026-06-19 02:44:16 on dist-test-slave-fbl4"
server_key: "f9f9a6be09a18e10f4cc37999e049bd2"
server_key_iv: "7aef04b984c54c0589e206b70ea9b7b8"
server_key_version: "encryptionkey@0"
I20260619 02:44:16.705431 13251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:16.717386 13251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:16.719296 13251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:16.719403 13251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:16.719573 13251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:16.719812 13251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:16.719841 13251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.719862 13251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:16.719875 13251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:16.725414 13251 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:36479
I20260619 02:44:16.725486 13379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:36479 every 8 connection(s)
I20260619 02:44:16.725776 13251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:16.733930 12975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.726624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:52625 (local address 127.12.145.126:43903)
0619 02:44:16.726695 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:16.726697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:16.726880 (+ 183us) server_negotiation.cc:407] Connection header received
0619 02:44:16.727299 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:16.727300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:16.727309 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:16.727357 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:16.728211 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.728685 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.729625 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.729802 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.729852 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.731737 (+ 1885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:16.731739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:16.731739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:16.731745 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:16.732890 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.733218 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.733219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.733219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.733274 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.733469 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.733469 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.733470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.733563 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:16.733610 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:16.733817 (+ 207us) server_negotiation.cc:299] Negotiation successful
0619 02:44:16.733870 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:44:16.734197 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.726601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:43903 (local address 127.12.145.67:52625)
0619 02:44:16.726757 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:16.726789 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:16.727225 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:16.727414 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:16.727417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:16.727962 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:16.728141 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:16.728146 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.728757 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.728758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:16.729554 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:16.729555 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.729871 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.729872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:16.729965 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.730373 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:16.730380 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:16.731659 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:16.732955 (+ 1296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:16.732959 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:16.732961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:16.733158 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:16.733329 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:16.733330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:16.733330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:16.733417 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:16.733614 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:16.733617 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:16.733716 (+ 99us) client_negotiation.cc:769] Sending connection context
0619 02:44:16.733791 (+ 75us) client_negotiation.cc:240] Negotiation successful
0619 02:44:16.733906 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":95,"threads_started":1}
I20260619 02:44:16.734709 13380 heartbeater.cc:347] Connected to a master server at 127.12.145.126:43903
I20260619 02:44:16.734813 13380 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:16.734975 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 13251
I20260619 02:44:16.734994 13380 heartbeater.cc:511] Master 127.12.145.126:43903 requested a full tablet report, sending...
I20260619 02:44:16.735062 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:16.735239 12869 external_mini_cluster.cc:1428] Setting key d3d38c94238ba43adee61db3b42eb1f8
I20260619 02:44:16.735392 12921 ts_manager.cc:194] Registered new tserver with Master: 32311fec5b3e4bd3b850b9d92e74346f (127.12.145.67:36479)
I20260619 02:44:16.735890 12921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:52625
I20260619 02:44:16.736270 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:16.758258 13387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.751008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43390 (local address 127.12.145.65:41223)
0619 02:44:16.751161 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:16.751165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:16.751175 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:44:16.751199 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:16.751200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:16.751213 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:16.751277 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:16.751784 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.752479 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.753358 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.753707 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.753773 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.755988 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:16.755995 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:16.755995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:16.756001 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:16.757284 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.757585 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.757587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.757587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.757637 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.757799 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.757800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.757800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.757911 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:16.758020 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:16.758071 (+ 51us) server_negotiation.cc:299] Negotiation successful
0619 02:44:16.758128 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
W20260619 02:44:16.758678 13026 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43390
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[12876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:16.779364 13387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:16.772879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43396 (local address 127.12.145.65:41223)
0619 02:44:16.772932 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:16.772934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:16.773003 (+ 69us) server_negotiation.cc:407] Connection header received
0619 02:44:16.773064 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:16.773065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:16.773075 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:16.773135 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:16.773794 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.774248 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.775016 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:16.775204 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:16.775258 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:16.777265 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:16.777266 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:16.777266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:16.777272 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:16.778465 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.778783 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.778784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.778784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.778831 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:16.778982 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:16.778983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:16.778983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:16.779058 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:16.779137 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:16.779205 (+ 68us) server_negotiation.cc:299] Negotiation successful
0619 02:44:16.779264 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:44:16.779870 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 12983
I20260619 02:44:16.784157 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 13117
I20260619 02:44:16.788383 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 13251
I20260619 02:44:16.792399 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 12889
2026-06-19T02:44:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1844 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[13394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[13394](info): set up 2 sockets
Jun 19 02:44:16 dist-test-slave-fbl4 krb5kdc[13394](info): commencing operation
krb5kdc: starting...
W20260619 02:44:17.826049 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:17 dist-test-slave-fbl4 krb5kdc[13394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:17.943434 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:41041
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:41041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:18.021625 13407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:18.021827 13407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:18.021850 13407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:18.022993 13407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:18.023041 13407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:18.023056 13407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:18.023068 13407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:18.023118 13407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:18.024521 13407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:41041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:41041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:18.024749 13407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:18.024966 13407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:18.029563 13415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.029613 13412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.029631 13413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:18.029808 13407 server_base.cc:1034] running on GCE node
I20260619 02:44:18.030042 13407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:18.030346 13407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:18.031494 13407 hybrid_clock.cc:648] HybridClock initialized: now 1781837058031462 us; error 49 us; skew 500 ppm
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837058, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:18.033818 13407 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:18.034216 13407 webserver.cc:460] Webserver started at http://127.12.145.126:33217/ using document root <none> and password file <none>
I20260619 02:44:18.034438 13407 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:18.034500 13407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:18.034686 13407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:18.036154 13407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "a0e4fc33343b4c49a73658c452f1b799"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "c0b43d88eba82a973e4fcf14fe2fb131"
server_key_iv: "62be1367151fa0f1b6899e634dc4fa73"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.036589 13407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "a0e4fc33343b4c49a73658c452f1b799"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "c0b43d88eba82a973e4fcf14fe2fb131"
server_key_iv: "62be1367151fa0f1b6899e634dc4fa73"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.038316 13407 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260619 02:44:18.039045 13422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.039204 13407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.039289 13407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "a0e4fc33343b4c49a73658c452f1b799"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "c0b43d88eba82a973e4fcf14fe2fb131"
server_key_iv: "62be1367151fa0f1b6899e634dc4fa73"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.039367 13407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:18.068056 13407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:18.069896 13407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:18.070053 13407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:18.073722 13407 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:41041
I20260619 02:44:18.073783 13474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:41041 every 8 connection(s)
I20260619 02:44:18.074112 13407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:18.075032 13475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:18.077134 13475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799: Bootstrap starting.
I20260619 02:44:18.077649 13475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:18.077927 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 13407
I20260619 02:44:18.077965 13475 log.cc:824] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:18.078015 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:18.078193 12869 external_mini_cluster.cc:1428] Setting key ea9e17a2c18200bd1465e53ed4059b1b
I20260619 02:44:18.078846 13475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799: No bootstrap required, opened a new log
I20260619 02:44:18.081398 13475 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e4fc33343b4c49a73658c452f1b799" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41041 } }
I20260619 02:44:18.081560 13475 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:18.081593 13475 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e4fc33343b4c49a73658c452f1b799, State: Initialized, Role: FOLLOWER
I20260619 02:44:18.081705 13475 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e4fc33343b4c49a73658c452f1b799" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41041 } }
I20260619 02:44:18.081769 13475 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:18.081796 13475 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:18.081837 13475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:18.082429 13475 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e4fc33343b4c49a73658c452f1b799" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41041 } }
I20260619 02:44:18.082512 13475 leader_election.cc:302] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0e4fc33343b4c49a73658c452f1b799; no voters:
I20260619 02:44:18.082784 13475 leader_election.cc:288] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:18.082806 13480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:18.083200 13480 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [term 1 LEADER]: Becoming Leader. State: Replica: a0e4fc33343b4c49a73658c452f1b799, State: Running, Role: LEADER
I20260619 02:44:18.083338 13475 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:18.083349 13480 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e4fc33343b4c49a73658c452f1b799" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41041 } }
I20260619 02:44:18.083819 13482 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0e4fc33343b4c49a73658c452f1b799. Latest consensus state: current_term: 1 leader_uuid: "a0e4fc33343b4c49a73658c452f1b799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e4fc33343b4c49a73658c452f1b799" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41041 } } }
I20260619 02:44:18.083909 13482 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:18.084136 13481 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0e4fc33343b4c49a73658c452f1b799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0e4fc33343b4c49a73658c452f1b799" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41041 } } }
I20260619 02:44:18.084379 13481 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:18.084607 13488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:18.085083 13488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:18.086582 13488 catalog_manager.cc:1347] Generated new cluster ID: ce1abf8ceeb745a4b880b17ec15ef30b
I20260619 02:44:18.086635 13488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:18.089066 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.078725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.12.145.126:41041)
0619 02:44:18.078897 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.078906 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.078940 (+ 34us) server_negotiation.cc:407] Connection header received
0619 02:44:18.079347 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.079353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.079398 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.079504 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:18.080229 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.081074 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.082108 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.082528 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.082670 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.085448 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:18.085452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:18.085452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:18.085466 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:18.087419 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.087846 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.087850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.087850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.087948 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.088149 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.088150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.088150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.088439 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:18.088585 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.088726 (+ 141us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.088857 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
I20260619 02:44:18.115809 13488 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:18.116550 13488 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:18.127979 13488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0e4fc33343b4c49a73658c452f1b799: Generated new TSK 0
I20260619 02:44:18.128162 13488 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:18.160800 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41041
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:18.239461 13501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:18.239663 13501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:18.239686 13501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:18.240746 13501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:18.240778 13501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:18.240805 13501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:18.242304 13501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41041
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:18.242482 13501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:18.242663 13501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:18.247264 13509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.247255 13506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.247252 13507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:18.247393 13501 server_base.cc:1034] running on GCE node
I20260619 02:44:18.247888 13501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:18.248090 13501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:18.249220 13501 hybrid_clock.cc:648] HybridClock initialized: now 1781837058249202 us; error 35 us; skew 500 ppm
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837058, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:18.251606 13501 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:18.251955 13501 webserver.cc:460] Webserver started at http://127.12.145.65:40345/ using document root <none> and password file <none>
I20260619 02:44:18.252118 13501 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:18.252156 13501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:18.252239 13501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:18.253145 13501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "2ccb42d711f41d16de89ea35ee326b51"
server_key_iv: "5c5e49124eb1e335a7084458bedaf6e4"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.253428 13501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "2ccb42d711f41d16de89ea35ee326b51"
server_key_iv: "5c5e49124eb1e335a7084458bedaf6e4"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.254670 13501 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:18.255319 13516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.255492 13501 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:18.255578 13501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "2ccb42d711f41d16de89ea35ee326b51"
server_key_iv: "5c5e49124eb1e335a7084458bedaf6e4"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.255648 13501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:18.270310 13501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:18.272042 13501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:18.272194 13501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:18.272403 13501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:18.272692 13501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:18.272728 13501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.272779 13501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:18.272812 13501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.278187 13501 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:45179
I20260619 02:44:18.278272 13629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:45179 every 8 connection(s)
I20260619 02:44:18.278600 13501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837058, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:18.285207 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 13501
I20260619 02:44:18.285313 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:18.285467 12869 external_mini_cluster.cc:1428] Setting key 06e168fd3bde373cf4a3c01fc418417b
I20260619 02:44:18.288249 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.279322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:46673 (local address 127.12.145.126:41041)
0619 02:44:18.279362 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.279364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.279561 (+ 197us) server_negotiation.cc:407] Connection header received
0619 02:44:18.280488 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.280490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.280502 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.280557 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:18.281149 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.281673 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.282750 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.282951 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.283035 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.285278 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:18.285280 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:18.285280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:18.285289 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:18.286836 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.287278 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.287279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.287280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.287348 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.287641 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.287641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.287642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.287747 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:18.287799 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.288112 (+ 313us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.288177 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:44:18.288488 13632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.279284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:41041 (local address 127.12.145.65:46673)
0619 02:44:18.279453 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.279485 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.280366 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.280620 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.280624 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.280875 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:18.281053 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.281057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.281782 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.281783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.282652 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.282655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.283042 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.283043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.283174 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.283662 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:18.283670 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:18.285189 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:18.286929 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:18.286935 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:18.286938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:18.287190 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:18.287424 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:18.287424 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:18.287425 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:18.287559 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:18.287817 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:18.287822 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:18.287981 (+ 159us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.288095 (+ 114us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.288272 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260619 02:44:18.288965 13630 heartbeater.cc:347] Connected to a master server at 127.12.145.126:41041
I20260619 02:44:18.289043 13630 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:18.289230 13630 heartbeater.cc:511] Master 127.12.145.126:41041 requested a full tablet report, sending...
I20260619 02:44:18.289759 13439 ts_manager.cc:194] Registered new tserver with Master: 00eb30e24d3f4cc3a3b4efba2a53f2d1 (127.12.145.65:45179)
I20260619 02:44:18.290426 13439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:46673
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:18.309065 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41041
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:18.388294 13635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:18.388504 13635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:18.388542 13635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:18.389672 13635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:18.389740 13635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:18.389786 13635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:18.391314 13635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41041
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:18.391564 13635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:18.391786 13635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:18.396517 13641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.396603 13640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.396518 13643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:18.396692 13635 server_base.cc:1034] running on GCE node
I20260619 02:44:18.396983 13635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:18.397189 13635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:18.398320 13635 hybrid_clock.cc:648] HybridClock initialized: now 1781837058398309 us; error 26 us; skew 500 ppm
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837058, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:18.400733 13635 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:18.401149 13635 webserver.cc:460] Webserver started at http://127.12.145.66:37197/ using document root <none> and password file <none>
I20260619 02:44:18.401335 13635 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:18.401373 13635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:18.401456 13635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:18.402355 13635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "168265eb982f49d0a61c89bee0f1acc0"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "759142cb5c64e1838dc79bc7f58e2804"
server_key_iv: "a41b8044dbf512d87ebc666c1b451fe9"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.402709 13635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "168265eb982f49d0a61c89bee0f1acc0"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "759142cb5c64e1838dc79bc7f58e2804"
server_key_iv: "a41b8044dbf512d87ebc666c1b451fe9"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.403920 13635 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:18.404605 13650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.404779 13635 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:18.404865 13635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "168265eb982f49d0a61c89bee0f1acc0"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "759142cb5c64e1838dc79bc7f58e2804"
server_key_iv: "a41b8044dbf512d87ebc666c1b451fe9"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.404943 13635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:18.413446 13635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:18.415201 13635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:18.415349 13635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:18.415558 13635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:18.415855 13635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:18.415908 13635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.415946 13635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:18.415972 13635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.421468 13635 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:43583
I20260619 02:44:18.421504 13763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:43583 every 8 connection(s)
I20260619 02:44:18.421813 13635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:18.423113 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 13635
I20260619 02:44:18.423207 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:18.423352 12869 external_mini_cluster.cc:1428] Setting key 5fbb68e1764ecba9a7edb1eddfa4022e
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837058, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
I20260619 02:44:18.431209 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.422475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:40285 (local address 127.12.145.126:41041)
0619 02:44:18.422606 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.422608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.422736 (+ 128us) server_negotiation.cc:407] Connection header received
0619 02:44:18.423734 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.423735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.423744 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.423797 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:18.424454 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.424933 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.425911 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.426101 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.426182 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.428542 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:18.428543 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:18.428544 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:18.428550 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:18.429826 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.430218 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.430219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.430219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.430278 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.430542 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.430561 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.430562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.430675 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:18.430765 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.431046 (+ 281us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.431120 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 02:44:18.431396 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.422434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:41041 (local address 127.12.145.66:40285)
0619 02:44:18.422619 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.422663 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.423599 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.423870 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.423874 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.424189 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:18.424360 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.424365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.425021 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.425022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.425811 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.425813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.426191 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.426192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.426326 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.426862 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:18.426869 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:18.428429 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:18.429918 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:18.429924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:18.429926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:18.430134 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:18.430340 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:18.430341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:18.430342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:18.430448 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:18.430757 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:18.430763 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:18.430908 (+ 145us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.431023 (+ 115us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.431169 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":84,"threads_started":1}
I20260619 02:44:18.431795 13764 heartbeater.cc:347] Connected to a master server at 127.12.145.126:41041
I20260619 02:44:18.431866 13764 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:18.432046 13764 heartbeater.cc:511] Master 127.12.145.126:41041 requested a full tablet report, sending...
I20260619 02:44:18.432404 13439 ts_manager.cc:194] Registered new tserver with Master: 168265eb982f49d0a61c89bee0f1acc0 (127.12.145.66:43583)
I20260619 02:44:18.432801 13439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:40285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:18.446337 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41041
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:18.523880 13769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:18.524055 13769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:18.524076 13769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:18.525128 13769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:18.525161 13769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:18.525185 13769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:18.526535 13769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41041
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:18.526726 13769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:18.526885 13769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:18.531541 13775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.531558 13774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:18.531641 13777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:18.531833 13769 server_base.cc:1034] running on GCE node
I20260619 02:44:18.532039 13769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:18.532267 13769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:18.533409 13769 hybrid_clock.cc:648] HybridClock initialized: now 1781837058533396 us; error 25 us; skew 500 ppm
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837058, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:18.535797 13769 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:18.536183 13769 webserver.cc:460] Webserver started at http://127.12.145.67:38419/ using document root <none> and password file <none>
I20260619 02:44:18.536419 13769 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:18.536485 13769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:18.536628 13769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:18.537600 13769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "19888629057d43bba007e205f5b468e6"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "4a1c1ec040a870e4003afcc01c22a03a"
server_key_iv: "32a96151f5e4c6fe918c3845638ea0f3"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.537931 13769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "19888629057d43bba007e205f5b468e6"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "4a1c1ec040a870e4003afcc01c22a03a"
server_key_iv: "32a96151f5e4c6fe918c3845638ea0f3"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.539291 13769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:18.539934 13784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.540119 13769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.540194 13769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "19888629057d43bba007e205f5b468e6"
format_stamp: "Formatted at 2026-06-19 02:44:18 on dist-test-slave-fbl4"
server_key: "4a1c1ec040a870e4003afcc01c22a03a"
server_key_iv: "32a96151f5e4c6fe918c3845638ea0f3"
server_key_version: "encryptionkey@0"
I20260619 02:44:18.540284 13769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:18.550051 13769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:18.551824 13769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:18.551972 13769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:18.552168 13769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:18.552462 13769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:18.552515 13769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.552553 13769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:18.552580 13769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:18.558173 13769 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:41553
I20260619 02:44:18.558205 13897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:41553 every 8 connection(s)
I20260619 02:44:18.558547 13769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:44:18.560473 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 13769
I20260619 02:44:18.560573 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:18.560731 12869 external_mini_cluster.cc:1428] Setting key 603634ea6a825ace2a10d6ea36088a10
Jun 19 02:44:18 dist-test-slave-fbl4 krb5kdc[13394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837058, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:18.567519 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.559285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:49667 (local address 127.12.145.126:41041)
0619 02:44:18.559323 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.559326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.559492 (+ 166us) server_negotiation.cc:407] Connection header received
0619 02:44:18.560420 (+ 928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.560421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.560430 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.560477 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:18.561207 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.561848 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.562966 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.563156 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.563210 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.565239 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:18.565240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:18.565240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:18.565246 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:18.566391 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.566787 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.566787 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.566788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.566838 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.567039 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.567040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.567040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.567134 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:18.567183 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.567400 (+ 217us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.567457 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260619 02:44:18.567685 13900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.559234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:41041 (local address 127.12.145.67:49667)
0619 02:44:18.559384 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.559423 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.560318 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.560565 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.560569 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.560921 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:18.561112 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.561116 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.561923 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.561923 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.562903 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.562906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.563223 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.563224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.563329 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.563827 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:18.563835 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:18.565160 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:18.566459 (+ 1299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:18.566464 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:18.566465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:18.566726 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:18.566896 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:18.566897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:18.566897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:18.566988 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:18.567186 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:18.567190 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:18.567298 (+ 108us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.567378 (+ 80us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.567488 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":90,"threads_started":1}
I20260619 02:44:18.568154 13898 heartbeater.cc:347] Connected to a master server at 127.12.145.126:41041
I20260619 02:44:18.568253 13898 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:18.568423 13898 heartbeater.cc:511] Master 127.12.145.126:41041 requested a full tablet report, sending...
I20260619 02:44:18.568800 13439 ts_manager.cc:194] Registered new tserver with Master: 19888629057d43bba007e205f5b468e6 (127.12.145.67:41553)
I20260619 02:44:18.569159 13439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:49667
I20260619 02:44:18.572345 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:44:18.579198 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.573825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50776 (local address 127.12.145.126:41041)
0619 02:44:18.573890 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.573891 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.573975 (+ 84us) server_negotiation.cc:407] Connection header received
0619 02:44:18.574045 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.574046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.574056 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.574102 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:18.574671 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.575163 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.575837 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.575996 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.576041 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.577027 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:18.577028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:18.577028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:18.577033 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:18.578201 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.578495 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.578495 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.578496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.578586 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:18.578770 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:18.578770 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:18.578771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:18.578898 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:18.578972 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.579052 (+ 80us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.579107 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:44:18.581020 13439 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:44:18.582455 13439 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:18.588608 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.584939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57410 (local address 127.12.145.66:43583)
0619 02:44:18.585086 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.585090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.585099 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:18.585139 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.585140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.585151 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.585239 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:18.585471 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.586507 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.587479 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.588245 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.588322 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.588381 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.588489 (+ 108us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.588533 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260619 02:44:18.588617 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.584727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:43583 (local address 127.0.0.1:57410)
0619 02:44:18.584807 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.584978 (+ 171us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.585016 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.585323 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.585324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.585326 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:18.585372 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.585395 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.586642 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.586643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.587396 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.587399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.588326 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.588327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.588396 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.588410 (+ 14us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.588480 (+ 70us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.588537 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"thread_start_us":55,"threads_started":1}
I20260619 02:44:18.588634 13907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.584528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:41553 (local address 127.0.0.1:59650)
0619 02:44:18.584726 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.584747 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.584814 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.585082 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.585085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.585088 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:18.585141 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.585142 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.586383 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.586384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.587593 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.587595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.588414 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.588416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.588486 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.588489 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.588536 (+ 47us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.588568 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":36,"spinlock_wait_cycles":384,"thread_start_us":57,"threads_started":1}
I20260619 02:44:18.589004 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.584676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59650 (local address 127.12.145.67:41553)
0619 02:44:18.584846 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.584850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.584863 (+ 13us) server_negotiation.cc:407] Connection header received
0619 02:44:18.584912 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.584914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.584929 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.585001 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:18.585222 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.586284 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.587672 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.588344 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.588408 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.588451 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.588670 (+ 219us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.588942 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260619 02:44:18.589278 13698 tablet_service.cc:1467] Processing CreateTablet for tablet 68a102550f3f4371aa7ce874e8f77af5 (DEFAULT_TABLE table=test-table [id=f5a96ae0524a44049ad91025ce8d9497]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:18.589627 13698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a102550f3f4371aa7ce874e8f77af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:18.589540 13832 tablet_service.cc:1467] Processing CreateTablet for tablet 68a102550f3f4371aa7ce874e8f77af5 (DEFAULT_TABLE table=test-table [id=f5a96ae0524a44049ad91025ce8d9497]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:18.589859 13832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a102550f3f4371aa7ce874e8f77af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:18.589877 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.584528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45179 (local address 127.0.0.1:35814)
0619 02:44:18.584663 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.584897 (+ 234us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.584928 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.585309 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.585310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.585311 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:18.585356 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.585357 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.586306 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.586308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.587597 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.587598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.589676 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.589677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.589740 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.589744 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.589777 (+ 33us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.589814 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":42,"thread_start_us":59,"threads_started":1}
I20260619 02:44:18.590170 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.584611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35814 (local address 127.12.145.65:45179)
0619 02:44:18.585148 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.585153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.585162 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:18.585197 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.585199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.585215 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.585310 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:18.585449 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.586195 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.588485 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.589547 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.589975 (+ 428us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.590034 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.590059 (+ 25us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.590098 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":82,"threads_started":1}
I20260619 02:44:18.592214 13912 tablet_bootstrap.cc:492] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0: Bootstrap starting.
I20260619 02:44:18.592537 13913 tablet_bootstrap.cc:492] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6: Bootstrap starting.
I20260619 02:44:18.592855 13912 tablet_bootstrap.cc:654] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:18.592878 13564 tablet_service.cc:1467] Processing CreateTablet for tablet 68a102550f3f4371aa7ce874e8f77af5 (DEFAULT_TABLE table=test-table [id=f5a96ae0524a44049ad91025ce8d9497]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:18.593187 13564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a102550f3f4371aa7ce874e8f77af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:18.593320 13913 tablet_bootstrap.cc:654] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:18.593655 13912 log.cc:824] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:18.593808 13913 log.cc:824] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:18.594476 13912 tablet_bootstrap.cc:492] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0: No bootstrap required, opened a new log
I20260619 02:44:18.594533 13913 tablet_bootstrap.cc:492] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6: No bootstrap required, opened a new log
I20260619 02:44:18.594596 13912 ts_tablet_manager.cc:1397] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:18.594676 13913 ts_tablet_manager.cc:1397] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:18.596210 13916 tablet_bootstrap.cc:492] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1: Bootstrap starting.
I20260619 02:44:18.596535 13913 raft_consensus.cc:348] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.596535 13912 raft_consensus.cc:348] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.596711 13913 raft_consensus.cc:374] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:18.596711 13912 raft_consensus.cc:374] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:18.596735 13916 tablet_bootstrap.cc:654] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:18.596747 13912 raft_consensus.cc:729] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 168265eb982f49d0a61c89bee0f1acc0, State: Initialized, Role: FOLLOWER
I20260619 02:44:18.596747 13913 raft_consensus.cc:729] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19888629057d43bba007e205f5b468e6, State: Initialized, Role: FOLLOWER
I20260619 02:44:18.596858 13912 consensus_queue.cc:260] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.596871 13913 consensus_queue.cc:260] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.597119 13912 ts_tablet_manager.cc:1428] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:18.597119 13913 ts_tablet_manager.cc:1428] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 02:44:18.597231 13898 heartbeater.cc:503] Master 127.12.145.126:41041 was elected leader, sending a full tablet report...
I20260619 02:44:18.597303 13916 log.cc:824] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:18.597517 13764 heartbeater.cc:503] Master 127.12.145.126:41041 was elected leader, sending a full tablet report...
I20260619 02:44:18.598006 13916 tablet_bootstrap.cc:492] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1: No bootstrap required, opened a new log
I20260619 02:44:18.598075 13916 ts_tablet_manager.cc:1397] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:18.599553 13916 raft_consensus.cc:348] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.599713 13916 raft_consensus.cc:374] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:18.599771 13916 raft_consensus.cc:729] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00eb30e24d3f4cc3a3b4efba2a53f2d1, State: Initialized, Role: FOLLOWER
I20260619 02:44:18.599881 13916 consensus_queue.cc:260] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.600142 13916 ts_tablet_manager.cc:1428] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:18.600277 13630 heartbeater.cc:503] Master 127.12.145.126:41041 was elected leader, sending a full tablet report...
W20260619 02:44:18.672533 13765 tablet.cc:2369] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:44:18.779269 13631 tablet.cc:2369] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:44:18.809105 13899 tablet.cc:2369] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:44:18.992242 13920 raft_consensus.cc:482] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:18.992399 13920 raft_consensus.cc:504] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.992794 13920 leader_election.cc:288] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19888629057d43bba007e205f5b468e6 (127.12.145.67:41553), 168265eb982f49d0a61c89bee0f1acc0 (127.12.145.66:43583)
I20260619 02:44:18.995829 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.993170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:59021 (local address 127.12.145.66:43583)
0619 02:44:18.993212 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.993214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.993234 (+ 20us) server_negotiation.cc:407] Connection header received
0619 02:44:18.993264 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.993265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.993274 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.993359 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:18.993521 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.994100 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.995118 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.995470 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.995562 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.995571 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.995726 (+ 155us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.995757 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260619 02:44:18.995829 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.993088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:36999 (local address 127.12.145.67:41553)
0619 02:44:18.993144 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:18.993146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:18.993209 (+ 63us) server_negotiation.cc:407] Connection header received
0619 02:44:18.993266 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:18.993267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:18.993276 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:18.993358 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:18.993548 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.994077 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.995118 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.995489 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.995575 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.995582 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:18.995727 (+ 145us) server_negotiation.cc:299] Negotiation successful
0619 02:44:18.995759 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260619 02:44:18.995889 13922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.993008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:43583 (local address 127.12.145.65:59021)
0619 02:44:18.993127 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.993139 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.993197 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.993367 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.993368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.993370 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:18.993446 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.993448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.994190 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.994191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.995025 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.995027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.995564 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.995564 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.995639 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.995643 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.995703 (+ 60us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.995744 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":76,"threads_started":1}
I20260619 02:44:18.996100 13921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:18.992982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:41553 (local address 127.12.145.65:36999)
0619 02:44:18.993124 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:18.993136 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:18.993210 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:18.993374 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:18.993375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:18.993377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:18.993475 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.993476 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.994163 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.994164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.995027 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:18.995029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:18.995573 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:18.995574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:18.995650 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:18.995653 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:18.995721 (+ 68us) client_negotiation.cc:240] Negotiation successful
0619 02:44:18.995759 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":49,"thread_start_us":84,"threads_started":1}
I20260619 02:44:18.996263 13718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a102550f3f4371aa7ce874e8f77af5" candidate_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "168265eb982f49d0a61c89bee0f1acc0" is_pre_election: true
I20260619 02:44:18.996439 13718 raft_consensus.cc:2454] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00eb30e24d3f4cc3a3b4efba2a53f2d1 in term 0.
I20260619 02:44:18.996467 13852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a102550f3f4371aa7ce874e8f77af5" candidate_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19888629057d43bba007e205f5b468e6" is_pre_election: true
I20260619 02:44:18.996635 13852 raft_consensus.cc:2454] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00eb30e24d3f4cc3a3b4efba2a53f2d1 in term 0.
I20260619 02:44:18.996675 13519 leader_election.cc:302] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00eb30e24d3f4cc3a3b4efba2a53f2d1, 168265eb982f49d0a61c89bee0f1acc0; no voters:
I20260619 02:44:18.996786 13920 raft_consensus.cc:2781] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:18.996840 13920 raft_consensus.cc:482] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:18.996870 13920 raft_consensus.cc:3037] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:18.997550 13920 raft_consensus.cc:504] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:18.997689 13920 leader_election.cc:288] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [CANDIDATE]: Term 1 election: Requested vote from peers 19888629057d43bba007e205f5b468e6 (127.12.145.67:41553), 168265eb982f49d0a61c89bee0f1acc0 (127.12.145.66:43583)
I20260619 02:44:18.997816 13852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a102550f3f4371aa7ce874e8f77af5" candidate_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19888629057d43bba007e205f5b468e6"
I20260619 02:44:18.997884 13852 raft_consensus.cc:3037] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:18.997875 13718 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a102550f3f4371aa7ce874e8f77af5" candidate_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "168265eb982f49d0a61c89bee0f1acc0"
I20260619 02:44:18.997954 13718 raft_consensus.cc:3037] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:18.998692 13718 raft_consensus.cc:2454] T 68a102550f3f4371aa7ce874e8f77af5 P 168265eb982f49d0a61c89bee0f1acc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00eb30e24d3f4cc3a3b4efba2a53f2d1 in term 1.
I20260619 02:44:18.998694 13852 raft_consensus.cc:2454] T 68a102550f3f4371aa7ce874e8f77af5 P 19888629057d43bba007e205f5b468e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00eb30e24d3f4cc3a3b4efba2a53f2d1 in term 1.
I20260619 02:44:18.998842 13519 leader_election.cc:302] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00eb30e24d3f4cc3a3b4efba2a53f2d1, 168265eb982f49d0a61c89bee0f1acc0; no voters:
I20260619 02:44:18.998950 13920 raft_consensus.cc:2781] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:18.999119 13920 raft_consensus.cc:686] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [term 1 LEADER]: Becoming Leader. State: Replica: 00eb30e24d3f4cc3a3b4efba2a53f2d1, State: Running, Role: LEADER
I20260619 02:44:18.999199 13920 consensus_queue.cc:237] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } }
I20260619 02:44:19.000021 13438 catalog_manager.cc:5495] T 68a102550f3f4371aa7ce874e8f77af5 P 00eb30e24d3f4cc3a3b4efba2a53f2d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00eb30e24d3f4cc3a3b4efba2a53f2d1 (127.12.145.65). New cstate: current_term: 1 leader_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00eb30e24d3f4cc3a3b4efba2a53f2d1" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19888629057d43bba007e205f5b468e6" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "168265eb982f49d0a61c89bee0f1acc0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43583 } health_report { overall_health: UNKNOWN } } }
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:19.032212 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:19.024640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35816 (local address 127.12.145.65:45179)
0619 02:44:19.024725 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:19.024728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:19.024837 (+ 109us) server_negotiation.cc:407] Connection header received
0619 02:44:19.024943 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:19.024945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:19.024956 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:19.025007 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:19.025561 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:19.026040 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:19.026813 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:19.027007 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:19.027093 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:19.029422 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:19.029436 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:19.029436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:19.029444 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:19.031037 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:19.031398 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:19.031401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:19.031402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:19.031463 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:19.031669 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:19.031670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:19.031671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:19.031818 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:19.031972 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:19.032022 (+ 50us) server_negotiation.cc:299] Negotiation successful
0619 02:44:19.032102 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837059, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837059, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:19.055903 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:19.048847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35818 (local address 127.12.145.65:45179)
0619 02:44:19.048919 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:19.048922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:19.048998 (+ 76us) server_negotiation.cc:407] Connection header received
0619 02:44:19.049089 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:19.049090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:19.049100 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:19.049156 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:19.049668 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:19.050134 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:19.050939 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:19.051144 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:19.051222 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:19.053483 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:19.053484 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:19.053485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:19.053491 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:19.054862 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:19.055166 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:19.055167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:19.055167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:19.055217 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:19.055383 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:19.055383 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:19.055383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:19.055476 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:19.055571 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:19.055699 (+ 128us) server_negotiation.cc:299] Negotiation successful
0619 02:44:19.055768 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:19.078239 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:19.070786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35828 (local address 127.12.145.65:45179)
0619 02:44:19.070865 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:19.070868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:19.070960 (+ 92us) server_negotiation.cc:407] Connection header received
0619 02:44:19.071045 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:19.071046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:19.071056 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:19.071126 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:19.071683 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:19.072160 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:19.072954 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:19.073155 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:19.073231 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:19.075937 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:19.075938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:19.075938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:19.075945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:19.077383 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:19.077679 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:19.077680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:19.077681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:19.077730 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:19.077881 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:19.077882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:19.077882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:19.077968 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:19.078055 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:19.078123 (+ 68us) server_negotiation.cc:299] Negotiation successful
0619 02:44:19.078179 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260619 02:44:19.078739 13544 tablet_service.cc:2908] Rejecting scan request for tablet 68a102550f3f4371aa7ce874e8f77af5: Uninitialized: clean time has not yet been initialized
I20260619 02:44:19.079552 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 13501
I20260619 02:44:19.084306 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 13635
I20260619 02:44:19.088511 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 13769
I20260619 02:44:19.092648 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 13407
2026-06-19T02:44:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2300 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13937](info): set up 2 sockets
Jun 19 02:44:19 dist-test-slave-fbl4 krb5kdc[13937](info): commencing operation
krb5kdc: starting...
W20260619 02:44:20.126155 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.002s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:20.235857 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33803
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:33803
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:20.312947 13950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:20.313164 13950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:20.313198 13950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:20.314316 13950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:20.314376 13950 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 02:44:20.314399 13950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:20.314422 13950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:20.314451 13950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:20.314476 13950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:20.315905 13950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:33803
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:20.316169 13950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:20.316383 13950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:20.321034 13956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:20.321028 13958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:20.321024 13955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:20.321220 13950 server_base.cc:1034] running on GCE node
I20260619 02:44:20.321520 13950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:20.321799 13950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:20.322970 13950 hybrid_clock.cc:648] HybridClock initialized: now 1781837060322958 us; error 25 us; skew 500 ppm
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:20.325372 13950 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:20.325778 13950 webserver.cc:460] Webserver started at http://127.12.145.126:40749/ using document root <none> and password file <none>
I20260619 02:44:20.325997 13950 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:20.326063 13950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:20.326210 13950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:20.327288 13950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "b55934eea8db40759926a3659504d38a"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "1541d06b5da998cc9c3f53d9f5cac876"
server_key_iv: "08eba3d7e34dc657c724045d764cc6ef"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.327647 13950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "b55934eea8db40759926a3659504d38a"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "1541d06b5da998cc9c3f53d9f5cac876"
server_key_iv: "08eba3d7e34dc657c724045d764cc6ef"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.328929 13950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:44:20.329687 13965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.329879 13950 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:20.329962 13950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "b55934eea8db40759926a3659504d38a"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "1541d06b5da998cc9c3f53d9f5cac876"
server_key_iv: "08eba3d7e34dc657c724045d764cc6ef"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.330013 13950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:20.340927 13950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:20.342762 13950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:20.342868 13950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:20.347069 13950 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:33803
I20260619 02:44:20.347153 14027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:33803 every 8 connection(s)
I20260619 02:44:20.347453 13950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:20.348083 14028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:20.349611 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 13950
I20260619 02:44:20.349709 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:20.349884 12869 external_mini_cluster.cc:1428] Setting key 3f6bfa417783b2e6b61579f3dfe0e25c
I20260619 02:44:20.350636 14028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a: Bootstrap starting.
I20260619 02:44:20.351166 14028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:20.351447 14028 log.cc:824] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:20.352169 14028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a: No bootstrap required, opened a new log
I20260619 02:44:20.353883 14028 raft_consensus.cc:348] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55934eea8db40759926a3659504d38a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33803 } }
I20260619 02:44:20.354040 14028 raft_consensus.cc:374] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:20.354103 14028 raft_consensus.cc:729] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b55934eea8db40759926a3659504d38a, State: Initialized, Role: FOLLOWER
I20260619 02:44:20.354244 14028 consensus_queue.cc:260] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55934eea8db40759926a3659504d38a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33803 } }
I20260619 02:44:20.354351 14028 raft_consensus.cc:388] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:20.354386 14028 raft_consensus.cc:482] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:20.354427 14028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:20.355019 14028 raft_consensus.cc:504] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55934eea8db40759926a3659504d38a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33803 } }
I20260619 02:44:20.355135 14028 leader_election.cc:302] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b55934eea8db40759926a3659504d38a; no voters:
I20260619 02:44:20.355329 14028 leader_election.cc:288] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:20.355353 14033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:20.355469 14033 raft_consensus.cc:686] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [term 1 LEADER]: Becoming Leader. State: Replica: b55934eea8db40759926a3659504d38a, State: Running, Role: LEADER
I20260619 02:44:20.355576 14028 sys_catalog.cc:564] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:20.355554 14033 consensus_queue.cc:237] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55934eea8db40759926a3659504d38a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33803 } }
I20260619 02:44:20.355893 14033 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b55934eea8db40759926a3659504d38a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55934eea8db40759926a3659504d38a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33803 } } }
I20260619 02:44:20.356041 14033 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:20.356213 14033 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55934eea8db40759926a3659504d38a. Latest consensus state: current_term: 1 leader_uuid: "b55934eea8db40759926a3659504d38a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55934eea8db40759926a3659504d38a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33803 } } }
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:20.356314 14033 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:20.356704 14041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:20.357240 14041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:20.358767 14041 catalog_manager.cc:1347] Generated new cluster ID: e9c2442f6bd54be2bb90812d10bb8e26
I20260619 02:44:20.358827 14041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:20.360679 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.350371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38908 (local address 127.12.145.126:33803)
0619 02:44:20.350577 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.350587 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.350618 (+ 31us) server_negotiation.cc:407] Connection header received
0619 02:44:20.351077 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.351084 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.351127 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.351283 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.351963 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.352861 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.353606 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.354016 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.354129 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.356891 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.356895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.356895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.356908 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.359116 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.359512 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.359515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.359515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.359607 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.359816 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.359817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.359817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.360077 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.360196 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.360347 (+ 151us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.360465 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260619 02:44:20.377331 14041 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:20.377841 14041 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:20.384859 14041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a: Generated new TSK 0
I20260619 02:44:20.385023 14041 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:20.413686 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33803
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:20.491156 14054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:20.491358 14054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:20.491381 14054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:20.492508 14054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:20.492547 14054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:20.492568 14054 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:44:20.492622 14054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:20.493991 14054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:20.494218 14054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:20.494446 14054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:20.499264 14060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:20.499306 14059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:20.499285 14062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:20.499481 14054 server_base.cc:1034] running on GCE node
I20260619 02:44:20.499684 14054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:20.499953 14054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:20.501104 14054 hybrid_clock.cc:648] HybridClock initialized: now 1781837060501092 us; error 48 us; skew 500 ppm
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:20.503546 14054 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:20.503896 14054 webserver.cc:460] Webserver started at http://127.12.145.65:45723/ using document root <none> and password file <none>
I20260619 02:44:20.504077 14054 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:20.504117 14054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:20.504199 14054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:20.505117 14054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "be8ce0d1e5244077b51b5c465119e677"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "c4d8c71f880e346815a3fd3227ef7bac"
server_key_iv: "09ba26cf11fbc533105c19818e1a3d75"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.505409 14054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "be8ce0d1e5244077b51b5c465119e677"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "c4d8c71f880e346815a3fd3227ef7bac"
server_key_iv: "09ba26cf11fbc533105c19818e1a3d75"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.506614 14054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:20.507284 14069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.507431 14054 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:20.507524 14054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "be8ce0d1e5244077b51b5c465119e677"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "c4d8c71f880e346815a3fd3227ef7bac"
server_key_iv: "09ba26cf11fbc533105c19818e1a3d75"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.507592 14054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:20.516311 14054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:20.518159 14054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:20.518316 14054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:20.518838 14054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:20.518877 14054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.518898 14054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:20.518934 14054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.525735 14054 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:42239
I20260619 02:44:20.525806 14184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:42239 every 8 connection(s)
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:20.526136 14054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:20.527906 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 14054
I20260619 02:44:20.528009 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:20.528194 12869 external_mini_cluster.cc:1428] Setting key eef2ed35a2241e423f89d7180dc55186
I20260619 02:44:20.529233 14078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.519255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33803 (local address 127.12.145.65:38493)
0619 02:44:20.519390 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.519426 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.519850 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.520099 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.520103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.520447 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:20.520718 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.520723 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.521695 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.521697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.523193 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.523196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.523730 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.523731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.523902 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.524551 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:20.524562 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:20.526474 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:20.527794 (+ 1320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.527801 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.527803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.528106 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.528334 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.528335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.528335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.528482 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.528781 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:20.528797 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:20.528912 (+ 115us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.528990 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.529097 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":75,"threads_started":1}
I20260619 02:44:20.529264 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.519297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:38493 (local address 127.12.145.126:33803)
0619 02:44:20.519369 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.519372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.519510 (+ 138us) server_negotiation.cc:407] Connection header received
0619 02:44:20.519936 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.519938 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.519951 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.520027 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.520799 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.521592 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.523293 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.523644 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.523718 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.526590 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.526591 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.526591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.526598 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.527719 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.528178 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.528179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.528180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.528231 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.528546 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.528547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.528547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.528690 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.528752 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.529044 (+ 292us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.529132 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260619 02:44:20.530373 14185 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33803
I20260619 02:44:20.530465 14185 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:20.530730 14185 heartbeater.cc:511] Master 127.12.145.126:33803 requested a full tablet report, sending...
I20260619 02:44:20.531262 13982 ts_manager.cc:194] Registered new tserver with Master: be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239)
I20260619 02:44:20.531939 13982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:38493
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
I20260619 02:44:20.537541 14192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.531369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33803 (local address 127.12.145.65:41779)
0619 02:44:20.531489 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.531500 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.531571 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.531725 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.531725 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.531922 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:20.531993 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.531995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.532978 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.532979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.533910 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.533913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.534233 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.534235 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.534317 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.534787 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:20.534792 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:20.535184 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:20.536754 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.536755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.536755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.536937 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.537085 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.537085 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.537085 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.537128 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.537280 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:20.537281 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:20.537311 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.537380 (+ 69us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.537441 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
I20260619 02:44:20.537629 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.531436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:41779 (local address 127.12.145.126:33803)
0619 02:44:20.531478 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.531480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.531549 (+ 69us) server_negotiation.cc:407] Connection header received
0619 02:44:20.531634 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.531635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.531644 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.531671 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.532080 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.532864 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.533989 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.534158 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.534214 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.535278 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.535279 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.535279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.535285 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.536663 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.536999 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.537000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.537000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.537045 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.537161 (+ 116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.537161 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.537161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.537243 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.537284 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.537393 (+ 109us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.537502 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:20.552791 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33803
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:20.630685 14194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:20.630896 14194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:20.630934 14194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:20.632169 14194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:20.632226 14194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:20.632258 14194 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:44:20.632295 14194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:20.633685 14194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:20.633942 14194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:20.634155 14194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:20.638877 14202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:20.638878 14200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:20.639016 14194 server_base.cc:1034] running on GCE node
W20260619 02:44:20.638934 14199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:20.639250 14194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:20.639523 14194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:20.640679 14194 hybrid_clock.cc:648] HybridClock initialized: now 1781837060640668 us; error 43 us; skew 500 ppm
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:20.643059 14194 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:20.643451 14194 webserver.cc:460] Webserver started at http://127.12.145.66:33971/ using document root <none> and password file <none>
I20260619 02:44:20.643671 14194 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:20.643736 14194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:20.643893 14194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:20.644871 14194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "dc623494fd614f20a4f307884b9ffd58"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "3435c7ae592268992f95cd5234d7c271"
server_key_iv: "0128da19f3043a38d18d8a016f4fb22a"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.645222 14194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "dc623494fd614f20a4f307884b9ffd58"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "3435c7ae592268992f95cd5234d7c271"
server_key_iv: "0128da19f3043a38d18d8a016f4fb22a"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.646466 14194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:44:20.647218 14209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.647379 14194 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:20.647472 14194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "dc623494fd614f20a4f307884b9ffd58"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "3435c7ae592268992f95cd5234d7c271"
server_key_iv: "0128da19f3043a38d18d8a016f4fb22a"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.647554 14194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:20.663323 14194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:20.665529 14194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:20.665684 14194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:20.666165 14194 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:20.666229 14194 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.666275 14194 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:20.666317 14194 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.673086 14194 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:37407
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:20.673156 14324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:37407 every 8 connection(s)
I20260619 02:44:20.673476 14194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:20.676342 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.666759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:50923 (local address 127.12.145.126:33803)
0619 02:44:20.666830 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.666833 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.667042 (+ 209us) server_negotiation.cc:407] Connection header received
0619 02:44:20.667485 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.667487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.667500 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.667578 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.668273 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.669085 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.670715 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.671040 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.671115 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.673584 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.673585 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.673586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.673593 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.674949 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.675348 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.675349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.675350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.675422 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.675685 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.675685 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.675686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.675803 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.675891 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.676165 (+ 274us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.676242 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:44:20.676514 14218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.666741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33803 (local address 127.12.145.66:50923)
0619 02:44:20.666908 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.666945 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.667389 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.667670 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.667673 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.667947 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:20.668174 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.668179 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.669190 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.669191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.670613 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.670616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.671134 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.671135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.671297 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.671748 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:20.671759 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:20.673489 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:20.675039 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.675045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.675047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.675258 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.675486 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.675487 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.675487 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.675612 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.675881 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:20.675886 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:20.676036 (+ 150us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.676143 (+ 107us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.676288 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260619 02:44:20.677011 14325 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33803
I20260619 02:44:20.677088 14325 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:20.677141 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 14194
I20260619 02:44:20.677240 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:20.677348 14325 heartbeater.cc:511] Master 127.12.145.126:33803 requested a full tablet report, sending...
I20260619 02:44:20.677443 12869 external_mini_cluster.cc:1428] Setting key 1e1fed84730842b305bfe7781efde85b
I20260619 02:44:20.677745 13981 ts_manager.cc:194] Registered new tserver with Master: dc623494fd614f20a4f307884b9ffd58 (127.12.145.66:37407)
I20260619 02:44:20.678256 13981 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:50923
I20260619 02:44:20.683580 14331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.677963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33803 (local address 127.12.145.66:37411)
0619 02:44:20.678071 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.678080 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.678128 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.678253 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.678254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.678436 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:20.678504 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.678506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.679193 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.679194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.679702 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.679704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.680087 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.680088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.680163 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.680567 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:20.680572 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:20.680817 (+ 245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:20.682621 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.682622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.682622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.682776 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.682980 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.682980 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.682981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.683028 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.683369 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:20.683370 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:20.683402 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.683448 (+ 46us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.683514 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":56,"threads_started":1}
I20260619 02:44:20.683679 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.677997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:37411 (local address 127.12.145.126:33803)
0619 02:44:20.678029 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.678031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.678135 (+ 104us) server_negotiation.cc:407] Connection header received
0619 02:44:20.678163 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.678164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.678174 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.678250 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.678622 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.679098 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.679797 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.680006 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.680085 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.680900 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.680901 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.680901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.680908 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.682506 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.682849 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.682850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.682851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.682912 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.683087 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.683087 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.683088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.683290 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.683379 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.683477 (+ 98us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.683554 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:20.701208 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33803
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:20.780874 14334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:20.781050 14334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:20.781073 14334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:20.782130 14334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:20.782161 14334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:20.782182 14334 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:44:20.782198 14334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:20.783528 14334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:20.783700 14334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:20.783855 14334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:20.788522 14340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:20.788609 14342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:20.788532 14339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:20.788749 14334 server_base.cc:1034] running on GCE node
I20260619 02:44:20.789006 14334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:20.789238 14334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:20.790386 14334 hybrid_clock.cc:648] HybridClock initialized: now 1781837060790380 us; error 29 us; skew 500 ppm
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:20.792802 14334 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:20.793180 14334 webserver.cc:460] Webserver started at http://127.12.145.67:35597/ using document root <none> and password file <none>
I20260619 02:44:20.793401 14334 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:20.793464 14334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:20.793624 14334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:20.794646 14334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "4a14eead972944ab9e4f0434b892e041"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "b7d29f8e2f9e1304aef19a11defdf861"
server_key_iv: "17bef1190401743c2916e15ea0958dd4"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.795033 14334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "4a14eead972944ab9e4f0434b892e041"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "b7d29f8e2f9e1304aef19a11defdf861"
server_key_iv: "17bef1190401743c2916e15ea0958dd4"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.796294 14334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:44:20.796947 14349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.797112 14334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:20.797194 14334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "4a14eead972944ab9e4f0434b892e041"
format_stamp: "Formatted at 2026-06-19 02:44:20 on dist-test-slave-fbl4"
server_key: "b7d29f8e2f9e1304aef19a11defdf861"
server_key_iv: "17bef1190401743c2916e15ea0958dd4"
server_key_version: "encryptionkey@0"
I20260619 02:44:20.797272 14334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:20.813289 14334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:20.815588 14334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:20.815742 14334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:20.816215 14334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:20.816268 14334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.816303 14334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:20.816359 14334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.822686 14334 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:38343
I20260619 02:44:20.822765 14464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:38343 every 8 connection(s)
I20260619 02:44:20.823040 14334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:20.825557 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 14334
I20260619 02:44:20.825646 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:20.825842 12869 external_mini_cluster.cc:1428] Setting key 9df8b5a405b4392e84dbb03bf4d7d24b
I20260619 02:44:20.825995 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.816873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:56751 (local address 127.12.145.126:33803)
0619 02:44:20.816920 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.816922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.817085 (+ 163us) server_negotiation.cc:407] Connection header received
0619 02:44:20.817566 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.817567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.817580 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.817631 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.818537 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.819404 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.820925 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.821182 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.821271 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.823646 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.823647 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.823648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.823654 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.824758 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.825091 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.825092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.825092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.825141 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.825314 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.825315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.825315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.825406 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.825455 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.825806 (+ 351us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.825867 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:44:20.826177 14358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.816766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33803 (local address 127.12.145.67:56751)
0619 02:44:20.816971 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.817003 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.817459 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.817714 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.817717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.818109 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:20.818384 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.818391 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.819500 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.819501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.820849 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.820853 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.821279 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.821280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.821417 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.821924 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:20.821935 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:20.823570 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:20.824827 (+ 1257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.824832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.824833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.825030 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.825181 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.825181 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.825182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.825264 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.825476 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:20.825482 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:20.825642 (+ 160us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.825787 (+ 145us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.825943 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":80,"threads_started":1}
I20260619 02:44:20.826671 14465 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33803
I20260619 02:44:20.826797 14465 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:20.826943 14465 heartbeater.cc:511] Master 127.12.145.126:33803 requested a full tablet report, sending...
I20260619 02:44:20.827280 13980 ts_manager.cc:194] Registered new tserver with Master: 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343)
I20260619 02:44:20.827700 13980 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:56751
I20260619 02:44:20.832708 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.827704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:36207 (local address 127.12.145.126:33803)
0619 02:44:20.827737 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.827739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.827826 (+ 87us) server_negotiation.cc:407] Connection header received
0619 02:44:20.827895 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.827896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.827905 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.827959 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.828273 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.828729 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.829417 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.829646 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.829733 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.830521 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.830522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.830522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.830528 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.831751 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.832135 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.832136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.832136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.832190 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.832351 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.832351 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.832352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.832437 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.832484 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.832595 (+ 111us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.832644 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260619 02:44:20.832724 14471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.827634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33803 (local address 127.12.145.67:36207)
0619 02:44:20.827770 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.827781 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.827840 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.827964 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.827965 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.828138 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:20.828186 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.828187 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.828819 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.828819 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.829323 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.829324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.829733 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.829734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.829809 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.830137 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:20.830141 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:20.830451 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:20.831816 (+ 1365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.831816 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.831817 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.832051 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.832245 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:20.832246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:20.832246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:20.832298 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:20.832475 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:20.832476 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:20.832506 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.832581 (+ 75us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.832660 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":62,"threads_started":1}
I20260619 02:44:20.837529 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 02:44:20 dist-test-slave-fbl4 krb5kdc[13937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:20.859218 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.852127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38912 (local address 127.12.145.126:33803)
0619 02:44:20.852185 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.852187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.852196 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:20.852219 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.852219 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.852231 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.852296 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:20.852831 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.853305 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.854007 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.854195 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.854267 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.856472 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:20.856473 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:20.856473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:20.856481 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:20.857850 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.858278 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.858279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.858279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.858360 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:20.858623 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:20.858623 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:20.858624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:20.858770 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:20.858884 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.859013 (+ 129us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.859102 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:44:20.863258 13980 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:44:20.865275 13980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:20.871542 14479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.867601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:42239 (local address 127.0.0.1:56970)
0619 02:44:20.867780 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.867819 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.867886 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.868229 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.868232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.868234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:20.868308 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.868311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.869207 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.869208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.870305 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.870307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.871246 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.871247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.871322 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.871336 (+ 14us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.871414 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.871469 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":61,"threads_started":1}
I20260619 02:44:20.871572 14483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.867834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56970 (local address 127.12.145.65:42239)
0619 02:44:20.867998 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.868004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.868015 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:44:20.868056 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.868058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.868074 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.868155 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:20.868388 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.869122 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.870398 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.871162 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.871233 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.871285 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.871438 (+ 153us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.871478 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
I20260619 02:44:20.871912 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.867692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57738 (local address 127.12.145.66:37407)
0619 02:44:20.868014 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.868018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.868050 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:44:20.868149 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.868151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.868168 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.868246 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:20.868451 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.869599 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.870851 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.871437 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.871495 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.871545 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.871748 (+ 203us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.871799 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":73,"threads_started":1}
I20260619 02:44:20.872006 14480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.867611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:38343 (local address 127.0.0.1:34940)
0619 02:44:20.868129 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.868137 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.868177 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.868425 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.868426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.868428 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:20.868460 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.868461 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.869691 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.869692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.870790 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.870792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.871764 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.871765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.871821 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.871825 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.871881 (+ 56us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.871921 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":1,"thread_start_us":55,"threads_started":1}
I20260619 02:44:20.872046 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.867823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34940 (local address 127.12.145.67:38343)
0619 02:44:20.868000 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.868005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.868235 (+ 230us) server_negotiation.cc:407] Connection header received
0619 02:44:20.868275 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.868278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.868293 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.868364 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:20.868538 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.869609 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.870880 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.871609 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.871677 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.871729 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.871900 (+ 171us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.871943 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":81,"threads_started":1}
I20260619 02:44:20.871814 14481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.867604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:37407 (local address 127.0.0.1:57738)
0619 02:44:20.868000 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.868009 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.868056 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.868316 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.868317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.868320 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:20.868375 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.868377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.869713 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.869714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.870769 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.870772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.871578 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.871578 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.871645 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.871649 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.871727 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.871758 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260619 02:44:20.872586 14119 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6315111ce4bdeb3131718edb0b775 (DEFAULT_TABLE table=test-table [id=0a39e89906cd420ebc75d6b9646c3ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:20.872753 14399 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6315111ce4bdeb3131718edb0b775 (DEFAULT_TABLE table=test-table [id=0a39e89906cd420ebc75d6b9646c3ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:20.872793 14259 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6315111ce4bdeb3131718edb0b775 (DEFAULT_TABLE table=test-table [id=0a39e89906cd420ebc75d6b9646c3ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:20.872946 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6315111ce4bdeb3131718edb0b775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:20.873078 14259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6315111ce4bdeb3131718edb0b775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:20.873078 14399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6315111ce4bdeb3131718edb0b775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:20.875995 14485 tablet_bootstrap.cc:492] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Bootstrap starting.
I20260619 02:44:20.876240 14486 tablet_bootstrap.cc:492] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Bootstrap starting.
I20260619 02:44:20.876575 14487 tablet_bootstrap.cc:492] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Bootstrap starting.
I20260619 02:44:20.876727 14485 tablet_bootstrap.cc:654] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:20.877115 14485 log.cc:824] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:20.877314 14486 tablet_bootstrap.cc:654] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:20.877383 14487 tablet_bootstrap.cc:654] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:20.877681 14486 log.cc:824] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:20.877730 14487 log.cc:824] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:20.878012 14485 tablet_bootstrap.cc:492] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: No bootstrap required, opened a new log
I20260619 02:44:20.878083 14485 ts_tablet_manager.cc:1397] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:20.878485 14486 tablet_bootstrap.cc:492] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: No bootstrap required, opened a new log
I20260619 02:44:20.878526 14487 tablet_bootstrap.cc:492] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: No bootstrap required, opened a new log
I20260619 02:44:20.878594 14487 ts_tablet_manager.cc:1397] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:20.878595 14486 ts_tablet_manager.cc:1397] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:20.879594 14485 raft_consensus.cc:348] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.879755 14485 raft_consensus.cc:374] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:20.879817 14485 raft_consensus.cc:729] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8ce0d1e5244077b51b5c465119e677, State: Initialized, Role: FOLLOWER
I20260619 02:44:20.879956 14485 consensus_queue.cc:260] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.880244 14185 heartbeater.cc:503] Master 127.12.145.126:33803 was elected leader, sending a full tablet report...
I20260619 02:44:20.880244 14485 ts_tablet_manager.cc:1428] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:20.880481 14486 raft_consensus.cc:348] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.880481 14487 raft_consensus.cc:348] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.880638 14486 raft_consensus.cc:374] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:20.880638 14487 raft_consensus.cc:374] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:20.880682 14487 raft_consensus.cc:729] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc623494fd614f20a4f307884b9ffd58, State: Initialized, Role: FOLLOWER
I20260619 02:44:20.880682 14486 raft_consensus.cc:729] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a14eead972944ab9e4f0434b892e041, State: Initialized, Role: FOLLOWER
I20260619 02:44:20.880800 14486 consensus_queue.cc:260] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.880800 14487 consensus_queue.cc:260] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.881047 14486 ts_tablet_manager.cc:1428] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:20.881047 14487 ts_tablet_manager.cc:1428] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:20.881083 14465 heartbeater.cc:503] Master 127.12.145.126:33803 was elected leader, sending a full tablet report...
I20260619 02:44:20.881152 14325 heartbeater.cc:503] Master 127.12.145.126:33803 was elected leader, sending a full tablet report...
I20260619 02:44:20.916148 14492 raft_consensus.cc:482] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:20.916301 14492 raft_consensus.cc:504] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.916648 14492 leader_election.cc:288] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239), 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343)
I20260619 02:44:20.919502 14483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.916869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:58491 (local address 127.12.145.65:42239)
0619 02:44:20.916910 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.916912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.916921 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:20.917017 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.917018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.917029 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.917101 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:20.917244 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.917705 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.918766 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.919120 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.919211 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.919220 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.919395 (+ 175us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.919431 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:44:20.919518 14218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.916806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:42239 (local address 127.12.145.66:58491)
0619 02:44:20.916869 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.916881 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.916928 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.917107 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.917108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.917109 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:20.917177 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.917178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.917805 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.917806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.918683 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.918685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.919210 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.919211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.919310 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.919313 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.919387 (+ 74us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.919423 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260619 02:44:20.919523 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.916888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:33905 (local address 127.12.145.67:38343)
0619 02:44:20.916932 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.916934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.917100 (+ 166us) server_negotiation.cc:407] Connection header received
0619 02:44:20.917183 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.917184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.917193 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.917251 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:20.917403 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.917854 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.918812 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.919155 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.919254 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.919262 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.919421 (+ 159us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.919454 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:44:20.919549 14494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.916810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:38343 (local address 127.12.145.66:33905)
0619 02:44:20.917031 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:20.917039 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:20.917114 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:20.917255 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:20.917256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:20.917257 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:20.917331 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.917333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.917950 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.917951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.918722 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:20.918724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.919253 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.919254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:20.919339 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.919341 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:44:20.919414 (+ 73us) client_negotiation.cc:240] Negotiation successful
0619 02:44:20.919451 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":59,"thread_start_us":111,"threads_started":1}
I20260619 02:44:20.919868 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6315111ce4bdeb3131718edb0b775" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a14eead972944ab9e4f0434b892e041" is_pre_election: true
I20260619 02:44:20.919880 14139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6315111ce4bdeb3131718edb0b775" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8ce0d1e5244077b51b5c465119e677" is_pre_election: true
I20260619 02:44:20.920020 14419 raft_consensus.cc:2454] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 0.
I20260619 02:44:20.920028 14139 raft_consensus.cc:2454] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 0.
I20260619 02:44:20.920225 14212 leader_election.cc:302] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a14eead972944ab9e4f0434b892e041, dc623494fd614f20a4f307884b9ffd58; no voters:
I20260619 02:44:20.920384 14492 raft_consensus.cc:2781] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:20.920429 14492 raft_consensus.cc:482] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:20.920444 14492 raft_consensus.cc:3037] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:20.921276 14492 raft_consensus.cc:504] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.921411 14492 leader_election.cc:288] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 election: Requested vote from peers be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239), 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343)
I20260619 02:44:20.921533 14139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6315111ce4bdeb3131718edb0b775" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8ce0d1e5244077b51b5c465119e677"
I20260619 02:44:20.921569 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6315111ce4bdeb3131718edb0b775" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a14eead972944ab9e4f0434b892e041"
I20260619 02:44:20.921608 14139 raft_consensus.cc:3037] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:20.921648 14419 raft_consensus.cc:3037] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:20.922266 14139 raft_consensus.cc:2454] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 1.
I20260619 02:44:20.922304 14419 raft_consensus.cc:2454] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 1.
I20260619 02:44:20.922459 14212 leader_election.cc:302] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a14eead972944ab9e4f0434b892e041, dc623494fd614f20a4f307884b9ffd58; no voters:
I20260619 02:44:20.922588 14492 raft_consensus.cc:2781] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:20.922757 14492 raft_consensus.cc:686] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 1 LEADER]: Becoming Leader. State: Replica: dc623494fd614f20a4f307884b9ffd58, State: Running, Role: LEADER
I20260619 02:44:20.922868 14492 consensus_queue.cc:237] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.923733 13981 catalog_manager.cc:5495] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc623494fd614f20a4f307884b9ffd58 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } health_report { overall_health: UNKNOWN } } }
W20260619 02:44:20.924069 14326 tablet.cc:2369] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:44:20.931699 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:20.929149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57752 (local address 127.12.145.66:37407)
0619 02:44:20.929205 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:20.929207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:20.929263 (+ 56us) server_negotiation.cc:407] Connection header received
0619 02:44:20.929347 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:20.929348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:20.929365 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:20.929418 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:20.929551 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.930015 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.930887 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:20.931082 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:20.931164 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:20.931365 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:20.931456 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:20.931536 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:20.931596 (+ 60us) server_negotiation.cc:299] Negotiation successful
0619 02:44:20.931615 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:44:20.933326 14139 raft_consensus.cc:1261] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Refusing update from remote peer dc623494fd614f20a4f307884b9ffd58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:20.933326 14419 raft_consensus.cc:1261] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Refusing update from remote peer dc623494fd614f20a4f307884b9ffd58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:20.933660 14492 consensus_queue.cc:1035] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:20.933781 14495 consensus_queue.cc:1035] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:20.935861 14498 mvcc.cc:205] Tried to move back new op lower bound from 7298404601580724224 to 7298404601540755456. Current Snapshot: MvccSnapshot[applied={T|T < 7298404601580724224}]
I20260619 02:44:20.935935 14500 mvcc.cc:205] Tried to move back new op lower bound from 7298404601580724224 to 7298404601540755456. Current Snapshot: MvccSnapshot[applied={T|T < 7298404601580724224}]
I20260619 02:44:20.939248 13981 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:20.939340 13981 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:20.940055 13981 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a: Sending DeleteTablet for 3 replicas of tablet 17d6315111ce4bdeb3131718edb0b775
I20260619 02:44:20.940361 14399 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6315111ce4bdeb3131718edb0b775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:20 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34940
I20260619 02:44:20.940387 14259 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6315111ce4bdeb3131718edb0b775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:20 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:57738
I20260619 02:44:20.940574 14509 tablet_replica.cc:330] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: stopping tablet replica
I20260619 02:44:20.940568 14119 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6315111ce4bdeb3131718edb0b775 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:20 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:56970
I20260619 02:44:20.940693 14509 raft_consensus.cc:2229] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:20.940805 14510 tablet_replica.cc:330] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: stopping tablet replica
I20260619 02:44:20.940806 14509 raft_consensus.cc:2258] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:20.940927 14510 raft_consensus.cc:2229] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:20.941010 13981 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 02:44:20.941071 14510 raft_consensus.cc:2258] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 02:44:20.941147 13981 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:20.941262 14509 ts_tablet_manager.cc:1905] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:20.941694 14510 ts_tablet_manager.cc:1905] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:20.942521 14399 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f (DEFAULT_TABLE table=test-table [id=91f6ead3b8b945708916d1d950b8a40f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:20.942660 14399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:20.943509 14509 ts_tablet_manager.cc:1918] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:20.943655 14509 log.cc:1196] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/17d6315111ce4bdeb3131718edb0b775
I20260619 02:44:20.943791 14510 ts_tablet_manager.cc:1918] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:20.943861 14510 log.cc:1196] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/17d6315111ce4bdeb3131718edb0b775
I20260619 02:44:20.943882 14486 tablet_bootstrap.cc:492] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Bootstrap starting.
I20260619 02:44:20.944110 14510 ts_tablet_manager.cc:1939] T 17d6315111ce4bdeb3131718edb0b775 P be8ce0d1e5244077b51b5c465119e677: Deleting consensus metadata
I20260619 02:44:20.944120 14509 ts_tablet_manager.cc:1939] T 17d6315111ce4bdeb3131718edb0b775 P 4a14eead972944ab9e4f0434b892e041: Deleting consensus metadata
I20260619 02:44:20.944229 14259 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f (DEFAULT_TABLE table=test-table [id=91f6ead3b8b945708916d1d950b8a40f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:20.944311 14486 tablet_bootstrap.cc:654] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:20.944348 14259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:20.944502 13967 catalog_manager.cc:4841] TS be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239): tablet 17d6315111ce4bdeb3131718edb0b775 (table test-table [id=0a39e89906cd420ebc75d6b9646c3ac2]) successfully deleted
I20260619 02:44:20.944797 13968 catalog_manager.cc:4841] TS 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343): tablet 17d6315111ce4bdeb3131718edb0b775 (table test-table [id=0a39e89906cd420ebc75d6b9646c3ac2]) successfully deleted
I20260619 02:44:20.945657 14487 tablet_bootstrap.cc:492] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: Bootstrap starting.
I20260619 02:44:20.945792 14119 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f (DEFAULT_TABLE table=test-table [id=91f6ead3b8b945708916d1d950b8a40f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:20.945912 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:20.946094 14487 tablet_bootstrap.cc:654] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:20.946729 14487 tablet_bootstrap.cc:492] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: No bootstrap required, opened a new log
I20260619 02:44:20.946789 14487 ts_tablet_manager.cc:1397] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:20.946943 14487 raft_consensus.cc:348] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.947021 14487 raft_consensus.cc:374] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:20.947047 14487 raft_consensus.cc:729] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc623494fd614f20a4f307884b9ffd58, State: Initialized, Role: FOLLOWER
I20260619 02:44:20.947088 14487 consensus_queue.cc:260] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.947178 14487 ts_tablet_manager.cc:1428] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.947296 14485 tablet_bootstrap.cc:492] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Bootstrap starting.
I20260619 02:44:20.947427 14508 tablet_replica.cc:330] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: stopping tablet replica
I20260619 02:44:20.947522 14508 raft_consensus.cc:2229] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:20.947602 14508 raft_consensus.cc:2258] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:20.947690 14485 tablet_bootstrap.cc:654] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:20.947999 14508 ts_tablet_manager.cc:1905] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:20.948405 14485 tablet_bootstrap.cc:492] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: No bootstrap required, opened a new log
I20260619 02:44:20.948454 14485 ts_tablet_manager.cc:1397] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:20.948599 14485 raft_consensus.cc:348] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.948670 14485 raft_consensus.cc:374] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:20.948704 14485 raft_consensus.cc:729] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8ce0d1e5244077b51b5c465119e677, State: Initialized, Role: FOLLOWER
I20260619 02:44:20.948750 14485 consensus_queue.cc:260] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.948846 14485 ts_tablet_manager.cc:1428] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:20.949515 14508 ts_tablet_manager.cc:1918] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:20.949582 14508 log.cc:1196] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/17d6315111ce4bdeb3131718edb0b775
I20260619 02:44:20.949824 14508 ts_tablet_manager.cc:1939] T 17d6315111ce4bdeb3131718edb0b775 P dc623494fd614f20a4f307884b9ffd58: Deleting consensus metadata
I20260619 02:44:20.950127 13969 catalog_manager.cc:4841] TS dc623494fd614f20a4f307884b9ffd58 (127.12.145.66:37407): tablet 17d6315111ce4bdeb3131718edb0b775 (table test-table [id=0a39e89906cd420ebc75d6b9646c3ac2]) successfully deleted
I20260619 02:44:20.955327 14486 tablet_bootstrap.cc:492] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: No bootstrap required, opened a new log
I20260619 02:44:20.955384 14486 ts_tablet_manager.cc:1397] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20260619 02:44:20.955531 14486 raft_consensus.cc:348] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.955621 14486 raft_consensus.cc:374] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:20.955646 14486 raft_consensus.cc:729] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a14eead972944ab9e4f0434b892e041, State: Initialized, Role: FOLLOWER
I20260619 02:44:20.955698 14486 consensus_queue.cc:260] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:20.955788 14486 ts_tablet_manager.cc:1428] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260619 02:44:21.026966 14186 tablet.cc:2369] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:44:21.031584 14504 raft_consensus.cc:482] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:21.031687 14504 raft_consensus.cc:504] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.031849 14504 leader_election.cc:288] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239), 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343)
I20260619 02:44:21.032073 14139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8f0c1f2e1437daaaa75c0449b1b4f" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8ce0d1e5244077b51b5c465119e677" is_pre_election: true
I20260619 02:44:21.032058 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8f0c1f2e1437daaaa75c0449b1b4f" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a14eead972944ab9e4f0434b892e041" is_pre_election: true
I20260619 02:44:21.032150 14139 raft_consensus.cc:2454] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 0.
I20260619 02:44:21.032161 14419 raft_consensus.cc:2454] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 0.
I20260619 02:44:21.032311 14212 leader_election.cc:302] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a14eead972944ab9e4f0434b892e041, dc623494fd614f20a4f307884b9ffd58; no voters:
I20260619 02:44:21.032402 14504 raft_consensus.cc:2781] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:21.032435 14504 raft_consensus.cc:482] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:21.032456 14504 raft_consensus.cc:3037] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:21.033367 14504 raft_consensus.cc:504] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.033516 14504 leader_election.cc:288] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 election: Requested vote from peers be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239), 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343)
I20260619 02:44:21.033684 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8f0c1f2e1437daaaa75c0449b1b4f" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a14eead972944ab9e4f0434b892e041"
I20260619 02:44:21.033697 14139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8f0c1f2e1437daaaa75c0449b1b4f" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8ce0d1e5244077b51b5c465119e677"
I20260619 02:44:21.033764 14419 raft_consensus.cc:3037] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:21.033766 14139 raft_consensus.cc:3037] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:21.034516 14419 raft_consensus.cc:2454] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 1.
I20260619 02:44:21.034515 14139 raft_consensus.cc:2454] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 1.
I20260619 02:44:21.034700 14212 leader_election.cc:302] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a14eead972944ab9e4f0434b892e041, dc623494fd614f20a4f307884b9ffd58; no voters:
I20260619 02:44:21.034790 14504 raft_consensus.cc:2781] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:21.034842 14504 raft_consensus.cc:686] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 1 LEADER]: Becoming Leader. State: Replica: dc623494fd614f20a4f307884b9ffd58, State: Running, Role: LEADER
I20260619 02:44:21.034895 14504 consensus_queue.cc:237] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.035532 13981 catalog_manager.cc:5495] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc623494fd614f20a4f307884b9ffd58 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } health_report { overall_health: UNKNOWN } } }
Jun 19 02:44:21 dist-test-slave-fbl4 krb5kdc[13937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:21.073650 14520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.067311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33803 (local address 127.0.0.1:38918)
0619 02:44:21.067466 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:21.067476 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:21.067545 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:21.067686 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:21.067687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:21.067963 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:21.068015 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:21.068017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.068644 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.068644 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:21.069150 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:21.069152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.069457 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.069458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:21.069497 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.070058 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:21.070063 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:21.071440 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:21.072774 (+ 1334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:21.072781 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:21.072782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:21.072965 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:21.073128 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:21.073129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:21.073129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:21.073181 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:21.073392 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:21.073398 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:21.073436 (+ 38us) client_negotiation.cc:769] Sending connection context
0619 02:44:21.073486 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:44:21.073564 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
W20260619 02:44:21.073645 14466 tablet.cc:2369] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:44:21.073742 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.067371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38918 (local address 127.12.145.126:33803)
0619 02:44:21.067437 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:21.067439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:21.067548 (+ 109us) server_negotiation.cc:407] Connection header received
0619 02:44:21.067585 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:21.067586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:21.067598 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:21.067679 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:21.068095 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.068577 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.069219 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.069397 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.069444 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.071518 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:21.071519 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:21.071519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:21.071525 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:21.072706 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:21.073027 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:21.073028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:21.073028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:21.073074 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:21.073240 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:21.073240 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:21.073240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:21.073340 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:21.073388 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:21.073566 (+ 178us) server_negotiation.cc:299] Negotiation successful
0619 02:44:21.073642 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260619 02:44:21.075837 13981 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:38918:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 02:44:21.076052 13981 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:21.077316 14119 tablet_service.cc:1467] Processing CreateTablet for tablet 2609ef4509404928b42427f5a106e67a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2de8b75d06de41aaafdc24552d84fe64]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:44:21.077339 14259 tablet_service.cc:1467] Processing CreateTablet for tablet 2609ef4509404928b42427f5a106e67a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2de8b75d06de41aaafdc24552d84fe64]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:44:21.077491 14259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2609ef4509404928b42427f5a106e67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:21.077492 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2609ef4509404928b42427f5a106e67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:21.078971 14487 tablet_bootstrap.cc:492] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: Bootstrap starting.
I20260619 02:44:21.079098 14399 tablet_service.cc:1467] Processing CreateTablet for tablet 2609ef4509404928b42427f5a106e67a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2de8b75d06de41aaafdc24552d84fe64]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:44:21.079245 14399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2609ef4509404928b42427f5a106e67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:21.079336 14487 tablet_bootstrap.cc:654] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:21.079571 14485 tablet_bootstrap.cc:492] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: Bootstrap starting.
I20260619 02:44:21.079854 14487 tablet_bootstrap.cc:492] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: No bootstrap required, opened a new log
I20260619 02:44:21.079905 14487 ts_tablet_manager.cc:1397] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:21.079937 14485 tablet_bootstrap.cc:654] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:21.080009 14487 raft_consensus.cc:348] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.080099 14487 raft_consensus.cc:374] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:21.080121 14487 raft_consensus.cc:729] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc623494fd614f20a4f307884b9ffd58, State: Initialized, Role: FOLLOWER
I20260619 02:44:21.080168 14487 consensus_queue.cc:260] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.080255 14487 ts_tablet_manager.cc:1428] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:21.080356 14504 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.080428 14504 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:21.080587 14485 tablet_bootstrap.cc:492] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: No bootstrap required, opened a new log
I20260619 02:44:21.080631 14485 ts_tablet_manager.cc:1397] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:21.080786 14486 tablet_bootstrap.cc:492] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: Bootstrap starting.
I20260619 02:44:21.080783 14485 raft_consensus.cc:348] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.080857 14485 raft_consensus.cc:374] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:21.080879 14485 raft_consensus.cc:729] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8ce0d1e5244077b51b5c465119e677, State: Initialized, Role: FOLLOWER
I20260619 02:44:21.080924 14485 consensus_queue.cc:260] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.081007 14485 ts_tablet_manager.cc:1428] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:21.081046 14491 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.081120 14491 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:21.081177 14486 tablet_bootstrap.cc:654] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:21.081835 14486 tablet_bootstrap.cc:492] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: No bootstrap required, opened a new log
I20260619 02:44:21.081874 14486 ts_tablet_manager.cc:1397] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:21.082029 14486 raft_consensus.cc:348] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.082082 14486 raft_consensus.cc:374] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:21.082096 14486 raft_consensus.cc:729] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a14eead972944ab9e4f0434b892e041, State: Initialized, Role: FOLLOWER
I20260619 02:44:21.082154 14486 consensus_queue.cc:260] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.082248 14486 ts_tablet_manager.cc:1428] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:21.082371 14493 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.082454 14493 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:21.213917 14504 raft_consensus.cc:482] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:21.214001 14504 raft_consensus.cc:504] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.214164 14504 leader_election.cc:288] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239), 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343)
I20260619 02:44:21.214371 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2609ef4509404928b42427f5a106e67a" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a14eead972944ab9e4f0434b892e041" is_pre_election: true
I20260619 02:44:21.214371 14139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2609ef4509404928b42427f5a106e67a" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8ce0d1e5244077b51b5c465119e677" is_pre_election: true
I20260619 02:44:21.214480 14139 raft_consensus.cc:2454] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 0.
I20260619 02:44:21.214480 14419 raft_consensus.cc:2454] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 0.
I20260619 02:44:21.214659 14212 leader_election.cc:302] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a14eead972944ab9e4f0434b892e041, dc623494fd614f20a4f307884b9ffd58; no voters:
I20260619 02:44:21.214785 14504 raft_consensus.cc:2781] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:21.214841 14504 raft_consensus.cc:482] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:21.214874 14504 raft_consensus.cc:3037] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:21.215519 14504 raft_consensus.cc:504] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.215656 14504 leader_election.cc:288] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 election: Requested vote from peers be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239), 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343)
I20260619 02:44:21.215778 14139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2609ef4509404928b42427f5a106e67a" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be8ce0d1e5244077b51b5c465119e677"
I20260619 02:44:21.215797 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2609ef4509404928b42427f5a106e67a" candidate_uuid: "dc623494fd614f20a4f307884b9ffd58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a14eead972944ab9e4f0434b892e041"
I20260619 02:44:21.215854 14139 raft_consensus.cc:3037] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:21.215883 14419 raft_consensus.cc:3037] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:21.216421 14139 raft_consensus.cc:2454] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 1.
I20260619 02:44:21.216521 14419 raft_consensus.cc:2454] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc623494fd614f20a4f307884b9ffd58 in term 1.
I20260619 02:44:21.216596 14211 leader_election.cc:302] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be8ce0d1e5244077b51b5c465119e677, dc623494fd614f20a4f307884b9ffd58; no voters:
I20260619 02:44:21.216694 14504 raft_consensus.cc:2781] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:21.216753 14504 raft_consensus.cc:686] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [term 1 LEADER]: Becoming Leader. State: Replica: dc623494fd614f20a4f307884b9ffd58, State: Running, Role: LEADER
I20260619 02:44:21.216804 14504 consensus_queue.cc:237] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } }
I20260619 02:44:21.217049 14495 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: TxnStatusTablet state changed. Reason: New leader dc623494fd614f20a4f307884b9ffd58. Latest consensus state: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.217132 14495 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:44:21.217260 14525 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 02:44:21.217398 14525 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 02:44:21.217376 13981 catalog_manager.cc:5495] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc623494fd614f20a4f307884b9ffd58 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } health_report { overall_health: UNKNOWN } } }
I20260619 02:44:21.225330 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.222910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57762 (local address 127.12.145.66:37407)
0619 02:44:21.222948 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:21.222950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:21.222993 (+ 43us) server_negotiation.cc:407] Connection header received
0619 02:44:21.223079 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:21.223080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:21.223089 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:21.223130 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:21.223260 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.223700 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.224738 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.224911 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.224970 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.225138 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:21.225160 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:21.225195 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:21.225267 (+ 72us) server_negotiation.cc:299] Negotiation successful
0619 02:44:21.225283 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:44:21.225381 14520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.222872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:37407 (local address 127.0.0.1:57762)
0619 02:44:21.222950 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:21.222961 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:21.223012 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:21.223147 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:21.223148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:21.223149 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:21.223205 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:21.223207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.223769 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.223770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:21.224663 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:21.224665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.224986 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.224987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:21.225051 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.225067 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:21.225212 (+ 145us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:21.225217 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:44:21.225265 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:44:21.225307 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260619 02:44:21.226215 14139 raft_consensus.cc:1261] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Refusing update from remote peer dc623494fd614f20a4f307884b9ffd58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:21.226271 14419 raft_consensus.cc:1261] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Refusing update from remote peer dc623494fd614f20a4f307884b9ffd58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:21.226428 14495 consensus_queue.cc:1035] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:21.226521 14504 consensus_queue.cc:1035] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:21.226962 14491 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: TxnStatusTablet state changed. Reason: New leader dc623494fd614f20a4f307884b9ffd58. Latest consensus state: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.227068 14491 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:21.227015 14493 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: TxnStatusTablet state changed. Reason: New leader dc623494fd614f20a4f307884b9ffd58. Latest consensus state: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.227140 14493 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:21.227562 14504 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.227650 14504 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:44:21.228358 14491 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.228435 14491 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P be8ce0d1e5244077b51b5c465119e677: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:21.228525 14492 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.228591 14492 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P dc623494fd614f20a4f307884b9ffd58: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:44:21.228852 14499 mvcc.cc:205] Tried to move back new op lower bound from 7298404602781274112 to 7298404602744385536. Current Snapshot: MvccSnapshot[applied={T|T < 7298404602781274112}]
I20260619 02:44:21.228955 14493 tablet_replica.cc:439] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc623494fd614f20a4f307884b9ffd58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 } } peers { permanent_uuid: "dc623494fd614f20a4f307884b9ffd58" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37407 } } peers { permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 } } }
I20260619 02:44:21.229022 14493 tablet_replica.cc:442] T 2609ef4509404928b42427f5a106e67a P 4a14eead972944ab9e4f0434b892e041: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:21.233835 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.231360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:47931 (local address 127.12.145.66:37407)
0619 02:44:21.231394 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:21.231397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:21.231405 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:21.231475 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:21.231476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:21.231485 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:21.231544 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:21.231619 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.232327 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.233102 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.233401 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.233464 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.233581 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:21.233610 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:21.233676 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:21.233749 (+ 73us) server_negotiation.cc:299] Negotiation successful
0619 02:44:21.233763 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:44:21.233920 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.231244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:37407 (local address 127.12.145.66:47931)
0619 02:44:21.231363 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:21.231372 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:21.231414 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:21.231545 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:21.231546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:21.231547 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:21.231583 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:21.231584 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.232390 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.232391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:21.233036 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:21.233038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.233471 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.233472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:21.233508 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.233519 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:21.233696 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:21.233697 (+ 1us) client_negotiation.cc:769] Sending connection context
0619 02:44:21.233745 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:44:21.233790 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":72,"threads_started":1}
I20260619 02:44:21.235814 14139 raft_consensus.cc:1261] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Refusing update from remote peer dc623494fd614f20a4f307884b9ffd58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:21.235860 14419 raft_consensus.cc:1261] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Refusing update from remote peer dc623494fd614f20a4f307884b9ffd58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:21.236011 14504 consensus_queue.cc:1035] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be8ce0d1e5244077b51b5c465119e677" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 42239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:21.236080 14495 consensus_queue.cc:1035] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a14eead972944ab9e4f0434b892e041" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:21.248755 13980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:21.248859 13980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:21.249437 13980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b55934eea8db40759926a3659504d38a: Sending DeleteTablet for 3 replicas of tablet 51d8f0c1f2e1437daaaa75c0449b1b4f
I20260619 02:44:21.249696 14119 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:21 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:56970
I20260619 02:44:21.249718 14399 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:21 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34940
I20260619 02:44:21.249799 14509 tablet_replica.cc:330] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: stopping tablet replica
I20260619 02:44:21.249806 14510 tablet_replica.cc:330] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: stopping tablet replica
I20260619 02:44:21.249851 14509 raft_consensus.cc:2229] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:21.249856 14510 raft_consensus.cc:2229] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:21.249894 14510 raft_consensus.cc:2258] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:21.249894 14509 raft_consensus.cc:2258] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:21.250166 14259 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d8f0c1f2e1437daaaa75c0449b1b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:21 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:57738
I20260619 02:44:21.250211 14509 ts_tablet_manager.cc:1905] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:21.250257 14508 tablet_replica.cc:330] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: stopping tablet replica
I20260619 02:44:21.250300 14508 raft_consensus.cc:2229] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:21.250344 14508 raft_consensus.cc:2258] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:21.250671 14508 ts_tablet_manager.cc:1905] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:21.251724 14510 ts_tablet_manager.cc:1905] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:21.252202 14508 ts_tablet_manager.cc:1918] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:21.252252 14508 log.cc:1196] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/51d8f0c1f2e1437daaaa75c0449b1b4f
I20260619 02:44:21.252463 14508 ts_tablet_manager.cc:1939] T 51d8f0c1f2e1437daaaa75c0449b1b4f P dc623494fd614f20a4f307884b9ffd58: Deleting consensus metadata
I20260619 02:44:21.252638 14509 ts_tablet_manager.cc:1918] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:21.252689 14509 log.cc:1196] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/51d8f0c1f2e1437daaaa75c0449b1b4f
I20260619 02:44:21.252885 14509 ts_tablet_manager.cc:1939] T 51d8f0c1f2e1437daaaa75c0449b1b4f P 4a14eead972944ab9e4f0434b892e041: Deleting consensus metadata
I20260619 02:44:21.252905 14510 ts_tablet_manager.cc:1918] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:21.252942 14510 log.cc:1196] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/51d8f0c1f2e1437daaaa75c0449b1b4f
I20260619 02:44:21.253120 14510 ts_tablet_manager.cc:1939] T 51d8f0c1f2e1437daaaa75c0449b1b4f P be8ce0d1e5244077b51b5c465119e677: Deleting consensus metadata
I20260619 02:44:21.253176 13969 catalog_manager.cc:4841] TS dc623494fd614f20a4f307884b9ffd58 (127.12.145.66:37407): tablet 51d8f0c1f2e1437daaaa75c0449b1b4f (table test-table [id=91f6ead3b8b945708916d1d950b8a40f]) successfully deleted
I20260619 02:44:21.253186 13968 catalog_manager.cc:4841] TS 4a14eead972944ab9e4f0434b892e041 (127.12.145.67:38343): tablet 51d8f0c1f2e1437daaaa75c0449b1b4f (table test-table [id=91f6ead3b8b945708916d1d950b8a40f]) successfully deleted
I20260619 02:44:21.253461 13967 catalog_manager.cc:4841] TS be8ce0d1e5244077b51b5c465119e677 (127.12.145.65:42239): tablet 51d8f0c1f2e1437daaaa75c0449b1b4f (table test-table [id=91f6ead3b8b945708916d1d950b8a40f]) successfully deleted
Jun 19 02:44:21 dist-test-slave-fbl4 krb5kdc[13937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837060, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:21.271811 14483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.258848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56986 (local address 127.12.145.65:42239)
0619 02:44:21.258908 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:21.258911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:21.259016 (+ 105us) server_negotiation.cc:407] Connection header received
0619 02:44:21.259093 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:21.259094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:21.259104 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:21.259161 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:21.259723 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.260196 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.260890 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.261075 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.261142 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.269044 (+ 7902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:21.269055 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:21.269056 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:21.269063 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:21.270662 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:21.271012 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:21.271016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:21.271016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:21.271073 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:21.271263 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:21.271263 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:21.271264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:21.271405 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:21.271556 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:21.271619 (+ 63us) server_negotiation.cc:299] Negotiation successful
0619 02:44:21.271699 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260619 02:44:21.272086 14179 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56986
I20260619 02:44:21.279287 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:21.273063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38922 (local address 127.12.145.126:33803)
0619 02:44:21.273106 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:21.273108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:21.273119 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:44:21.273187 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:21.273187 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:21.273195 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:21.273238 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:21.273795 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.274260 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.275263 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:21.275438 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:21.275491 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:21.276755 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:21.276756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:21.276757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:21.276763 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:21.278257 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:21.278643 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:21.278644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:21.278644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:21.278690 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:21.278882 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:21.278882 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:21.278883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:21.278977 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:21.279045 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:21.279171 (+ 126us) server_negotiation.cc:299] Negotiation successful
0619 02:44:21.279223 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260619 02:44:21.279498 13980 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38922
I20260619 02:44:21.280085 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 14054
I20260619 02:44:21.287014 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 14194
I20260619 02:44:21.292702 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 14334
I20260619 02:44:21.297156 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 13950
2026-06-19T02:44:21Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2204 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:21 dist-test-slave-fbl4 krb5kdc[14543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:21 dist-test-slave-fbl4 krb5kdc[14543](info): set up 2 sockets
Jun 19 02:44:21 dist-test-slave-fbl4 krb5kdc[14543](info): commencing operation
krb5kdc: starting...
W20260619 02:44:22.354276 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:22 dist-test-slave-fbl4 krb5kdc[14543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:22.464957 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36595
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:36595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:22.543421 14556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:22.543635 14556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:22.543670 14556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:22.544798 14556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:22.544857 14556 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 02:44:22.544880 14556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:22.544909 14556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:22.544934 14556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:22.544961 14556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:22.546399 14556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:36595
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:22.546672 14556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:22.546880 14556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:22.551306 14561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:22.551311 14562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:22.551435 14556 server_base.cc:1034] running on GCE node
W20260619 02:44:22.551311 14564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:22.551739 14556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:22.552032 14556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:22.553189 14556 hybrid_clock.cc:648] HybridClock initialized: now 1781837062553181 us; error 33 us; skew 500 ppm
Jun 19 02:44:22 dist-test-slave-fbl4 krb5kdc[14543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:22.555532 14556 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:22.555984 14556 webserver.cc:460] Webserver started at http://127.12.145.126:37595/ using document root <none> and password file <none>
I20260619 02:44:22.556208 14556 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:22.556278 14556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:22.556421 14556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:22.557417 14556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "248c2b2c00a5462a84ba7ce8a2857166"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "f4ace095812e471f62b9bf931ec2582c"
server_key_iv: "4afc3d13654b22a1372891f3eaa9dbfa"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.557757 14556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "248c2b2c00a5462a84ba7ce8a2857166"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "f4ace095812e471f62b9bf931ec2582c"
server_key_iv: "4afc3d13654b22a1372891f3eaa9dbfa"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.559046 14556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260619 02:44:22.559722 14571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:22.559880 14556 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:22.559969 14556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "248c2b2c00a5462a84ba7ce8a2857166"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "f4ace095812e471f62b9bf931ec2582c"
server_key_iv: "4afc3d13654b22a1372891f3eaa9dbfa"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.560042 14556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:22.575063 14556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:22.576841 14556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:22.576990 14556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:22.581651 14556 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:36595
I20260619 02:44:22.581712 14633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:36595 every 8 connection(s)
I20260619 02:44:22.582005 14556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:22.582602 14634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:22.584753 14634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Bootstrap starting.
I20260619 02:44:22.585316 14634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:22.585588 14634 log.cc:824] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:22.586220 14634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: No bootstrap required, opened a new log
I20260619 02:44:22.588241 14634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248c2b2c00a5462a84ba7ce8a2857166" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36595 } }
I20260619 02:44:22.588415 14634 raft_consensus.cc:374] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:22.588461 14634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248c2b2c00a5462a84ba7ce8a2857166, State: Initialized, Role: FOLLOWER
I20260619 02:44:22.588603 14634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248c2b2c00a5462a84ba7ce8a2857166" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36595 } }
I20260619 02:44:22.588678 14634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:22.588719 14634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:22.588765 14634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:22.589257 14634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248c2b2c00a5462a84ba7ce8a2857166" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36595 } }
I20260619 02:44:22.589363 14634 leader_election.cc:302] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 248c2b2c00a5462a84ba7ce8a2857166; no voters:
I20260619 02:44:22.589522 14634 leader_election.cc:288] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:22.589565 14637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:22.589715 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 14556
I20260619 02:44:22.589799 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:22.589787 14637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [term 1 LEADER]: Becoming Leader. State: Replica: 248c2b2c00a5462a84ba7ce8a2857166, State: Running, Role: LEADER
I20260619 02:44:22.589795 14634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:22.589882 14637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248c2b2c00a5462a84ba7ce8a2857166" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36595 } }
I20260619 02:44:22.590006 12869 external_mini_cluster.cc:1428] Setting key de86cabfab046d35489395b934e87206
I20260619 02:44:22.590170 14638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "248c2b2c00a5462a84ba7ce8a2857166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248c2b2c00a5462a84ba7ce8a2857166" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36595 } } }
I20260619 02:44:22.590278 14638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:22.590499 14639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 248c2b2c00a5462a84ba7ce8a2857166. Latest consensus state: current_term: 1 leader_uuid: "248c2b2c00a5462a84ba7ce8a2857166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248c2b2c00a5462a84ba7ce8a2857166" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36595 } } }
I20260619 02:44:22.590828 14639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:22.590829 14643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:22.591423 14643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:22.592990 14643 catalog_manager.cc:1347] Generated new cluster ID: e1c21371f0e6427e97aa2db840d1359b
I20260619 02:44:22.593040 14643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:44:22 dist-test-slave-fbl4 krb5kdc[14543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:22.601603 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.590592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39338 (local address 127.12.145.126:36595)
0619 02:44:22.591162 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:22.591183 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:22.591217 (+ 34us) server_negotiation.cc:407] Connection header received
0619 02:44:22.591351 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:22.591358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:22.591412 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:22.591552 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:22.592346 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.593661 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.594742 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.595364 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.595477 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.598108 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:22.598112 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:22.598112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:22.598123 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:22.600009 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.600405 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.600407 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.600408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.600518 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.600731 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.600732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.600732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.601015 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:22.601158 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:22.601276 (+ 118us) server_negotiation.cc:299] Negotiation successful
0619 02:44:22.601401 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":72,"threads_started":1}
I20260619 02:44:22.610150 14643 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:22.610864 14643 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:22.623070 14643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Generated new TSK 0
I20260619 02:44:22.623245 14643 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:22.648746 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36595
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:22.726698 14660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:22.726913 14660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:22.726936 14660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:22.728045 14660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:22.728085 14660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:22.728106 14660 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 02:44:22.728152 14660 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:44:22.728176 14660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:22.729598 14660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:36595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:22.729794 14660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:22.729997 14660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:22.734771 14668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:22.734783 14666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:22.734833 14660 server_base.cc:1034] running on GCE node
W20260619 02:44:22.734783 14665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:22.735098 14660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:22.735358 14660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:22.736521 14660 hybrid_clock.cc:648] HybridClock initialized: now 1781837062736500 us; error 27 us; skew 500 ppm
Jun 19 02:44:22 dist-test-slave-fbl4 krb5kdc[14543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:22.738781 14660 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:22.739224 14660 webserver.cc:460] Webserver started at http://127.12.145.65:42229/ using document root <none> and password file <none>
I20260619 02:44:22.739441 14660 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:22.739502 14660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:22.739629 14660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:22.740597 14660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "93aefd7bd3cd4e809437cf5dbebf5203"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "32ffc4b5b78f4d981887c87bf1609237"
server_key_iv: "e4c2078a17b2c4eae40685da39df7ef8"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.740945 14660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "93aefd7bd3cd4e809437cf5dbebf5203"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "32ffc4b5b78f4d981887c87bf1609237"
server_key_iv: "e4c2078a17b2c4eae40685da39df7ef8"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.742152 14660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:22.742916 14675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:22.743075 14660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:22.743165 14660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "93aefd7bd3cd4e809437cf5dbebf5203"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "32ffc4b5b78f4d981887c87bf1609237"
server_key_iv: "e4c2078a17b2c4eae40685da39df7ef8"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.743242 14660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:22.750350 14660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:22.752030 14660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:22.752185 14660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:22.752696 14660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:22.752748 14660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:22.752779 14660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:22.752800 14660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 02:44:22 dist-test-slave-fbl4 krb5kdc[14543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:22.759932 14660 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:33263
I20260619 02:44:22.759990 14790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:33263 every 8 connection(s)
I20260619 02:44:22.760289 14660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:22.762089 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.753064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:45633 (local address 127.12.145.126:36595)
0619 02:44:22.753127 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:22.753130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:22.753360 (+ 230us) server_negotiation.cc:407] Connection header received
0619 02:44:22.754038 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:22.754039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:22.754049 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:22.754091 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:22.754992 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.755494 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.756535 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.756745 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.756812 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.759420 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:22.759421 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:22.759422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:22.759430 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:22.761050 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.761387 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.761388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.761388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.761436 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.761623 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.761624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.761624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.761730 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:22.761778 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:22.761969 (+ 191us) server_negotiation.cc:299] Negotiation successful
0619 02:44:22.762028 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260619 02:44:22.762274 14684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.753036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36595 (local address 127.12.145.65:45633)
0619 02:44:22.753216 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:22.753262 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:22.753936 (+ 674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:22.754164 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:22.754169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:22.754590 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:22.754895 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.754902 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.755588 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.755588 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.756445 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.756447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.756830 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.756831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.756937 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.757392 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:22.757400 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:22.759328 (+ 1928us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:22.761118 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.761122 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.761123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.761326 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.761488 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.761489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.761489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.761575 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.761782 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:22.761786 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:22.761883 (+ 97us) client_negotiation.cc:769] Sending connection context
0619 02:44:22.761958 (+ 75us) client_negotiation.cc:240] Negotiation successful
0619 02:44:22.762066 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260619 02:44:22.762768 14791 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36595
I20260619 02:44:22.762844 14791 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:22.763017 14791 heartbeater.cc:511] Master 127.12.145.126:36595 requested a full tablet report, sending...
I20260619 02:44:22.763243 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 14660
I20260619 02:44:22.763335 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:22.763515 12869 external_mini_cluster.cc:1428] Setting key 18d5ee9f9da567b232ade251db4ab81d
I20260619 02:44:22.763584 14587 ts_manager.cc:194] Registered new tserver with Master: 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263)
I20260619 02:44:22.764366 14587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:45633
I20260619 02:44:22.769363 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.763817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:35389 (local address 127.12.145.126:36595)
0619 02:44:22.763859 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:22.763861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:22.763985 (+ 124us) server_negotiation.cc:407] Connection header received
0619 02:44:22.764045 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:22.764045 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:22.764055 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:22.764101 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:22.764430 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.765042 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.765740 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.765946 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.766012 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.766981 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:22.766982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:22.766983 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:22.766989 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:22.768275 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.768604 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.768605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.768605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.768655 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.768871 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.768872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.768872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.768972 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:22.769057 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:22.769206 (+ 149us) server_negotiation.cc:299] Negotiation successful
0619 02:44:22.769278 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:44:22.769378 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.763761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36595 (local address 127.12.145.65:35389)
0619 02:44:22.763916 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:22.763927 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:22.763983 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:22.764103 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:22.764103 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:22.764288 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:22.764354 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.764355 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.765128 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.765129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.765662 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.765663 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.766022 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.766022 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.766101 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.766503 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:22.766508 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:22.766883 (+ 375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:22.768364 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.768365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.768365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.768524 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.768736 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.768737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.768738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.768793 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.769031 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:22.769032 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:22.769103 (+ 71us) client_negotiation.cc:769] Sending connection context
0619 02:44:22.769182 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:44:22.769284 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:22.787160 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36595
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:22.868196 14800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:22.868417 14800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:22.868458 14800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:22.869570 14800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:22.869629 14800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:22.869663 14800 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 02:44:22.869689 14800 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:44:22.869726 14800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:22.871212 14800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:36595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:22.871474 14800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:22.871678 14800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:22.876278 14806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:22.876364 14800 server_base.cc:1034] running on GCE node
W20260619 02:44:22.876286 14805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:22.876464 14808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:22.876668 14800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:22.876909 14800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:22.878062 14800 hybrid_clock.cc:648] HybridClock initialized: now 1781837062878050 us; error 27 us; skew 500 ppm
Jun 19 02:44:22 dist-test-slave-fbl4 krb5kdc[14543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:22.880489 14800 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:22.880918 14800 webserver.cc:460] Webserver started at http://127.12.145.66:39507/ using document root <none> and password file <none>
I20260619 02:44:22.881131 14800 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:22.881192 14800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:22.881340 14800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:22.882292 14800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "4f2d03fdc8204f9288e3a7644eefb4d0"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "70ac8316b254119de293eeec564a5c9d"
server_key_iv: "76cb2550dade8e6d06789a99a694e95d"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.882666 14800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "4f2d03fdc8204f9288e3a7644eefb4d0"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "70ac8316b254119de293eeec564a5c9d"
server_key_iv: "76cb2550dade8e6d06789a99a694e95d"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.883900 14800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:22.884521 14815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:22.884666 14800 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:22.884754 14800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "4f2d03fdc8204f9288e3a7644eefb4d0"
format_stamp: "Formatted at 2026-06-19 02:44:22 on dist-test-slave-fbl4"
server_key: "70ac8316b254119de293eeec564a5c9d"
server_key_iv: "76cb2550dade8e6d06789a99a694e95d"
server_key_version: "encryptionkey@0"
I20260619 02:44:22.884830 14800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:22.898972 14800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:22.901041 14800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:22.901185 14800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:22.901671 14800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:22.901728 14800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:22.901762 14800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:22.901793 14800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 02:44:22 dist-test-slave-fbl4 krb5kdc[14543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:22.909025 14800 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:38385
I20260619 02:44:22.909101 14930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:38385 every 8 connection(s)
I20260619 02:44:22.909379 14800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:22.910506 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.902043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:36287 (local address 127.12.145.126:36595)
0619 02:44:22.902100 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:22.902102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:22.902294 (+ 192us) server_negotiation.cc:407] Connection header received
0619 02:44:22.902904 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:22.902905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:22.902918 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:22.902980 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:22.903532 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.904016 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.904988 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.905229 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.905310 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.907613 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:22.907614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:22.907614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:22.907623 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:22.909290 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.909716 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.909717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.909718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.909794 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.910011 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.910012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.910012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.910112 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:22.910163 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:22.910384 (+ 221us) server_negotiation.cc:299] Negotiation successful
0619 02:44:22.910445 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:44:22.910703 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.902039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36595 (local address 127.12.145.66:36287)
0619 02:44:22.902185 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:22.902218 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:22.902803 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:22.903046 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:22.903049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:22.903276 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:22.903441 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.903445 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.904101 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.904102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.904899 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.904901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.905319 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.905320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.905438 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.905930 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:22.905937 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:22.907522 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:22.909377 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.909383 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.909385 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.909648 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.909867 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.909868 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.909868 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.909964 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.910164 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:22.910168 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:22.910278 (+ 110us) client_negotiation.cc:769] Sending connection context
0619 02:44:22.910357 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:44:22.910468 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":90,"threads_started":1}
I20260619 02:44:22.911222 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 14800
I20260619 02:44:22.911231 14931 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36595
I20260619 02:44:22.911316 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:22.911324 14931 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:22.911481 14931 heartbeater.cc:511] Master 127.12.145.126:36595 requested a full tablet report, sending...
I20260619 02:44:22.911513 12869 external_mini_cluster.cc:1428] Setting key 5a86a93c987e3bb7c8b9c4c67c6076b7
I20260619 02:44:22.911811 14587 ts_manager.cc:194] Registered new tserver with Master: 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385)
I20260619 02:44:22.912295 14587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:36287
I20260619 02:44:22.918423 14937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.912222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36595 (local address 127.12.145.66:41273)
0619 02:44:22.912352 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:22.912361 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:22.912434 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:22.912559 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:22.912560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:22.912757 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:22.912830 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.912832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.913690 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.913691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.914529 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:22.914531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.915011 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.915012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:22.915066 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.915440 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:22.915443 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:22.915687 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:22.917443 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.917443 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.917444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.917601 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.917802 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:22.917802 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:22.917803 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:22.917850 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:22.918148 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:22.918148 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:22.918185 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 02:44:22.918235 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:44:22.918339 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260619 02:44:22.918432 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:22.912261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:41273 (local address 127.12.145.126:36595)
0619 02:44:22.912299 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:22.912301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:22.912425 (+ 124us) server_negotiation.cc:407] Connection header received
0619 02:44:22.912492 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:22.912492 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:22.912502 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:22.912558 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:22.912904 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.913611 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.914633 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:22.914948 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:22.915013 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:22.915795 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:22.915796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:22.915797 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:22.915804 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:22.917360 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.917666 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.917667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.917667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.917729 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:22.917901 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:22.917902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:22.917902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:22.918086 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:22.918159 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:22.918262 (+ 103us) server_negotiation.cc:299] Negotiation successful
0619 02:44:22.918335 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:22.935320 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36595
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:23.014650 14940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:23.014855 14940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:23.014881 14940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:23.016001 14940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:23.016043 14940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:23.016069 14940 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 02:44:23.016121 14940 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:44:23.016152 14940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:23.017800 14940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:36595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:23.018036 14940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:23.018253 14940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:23.023001 14946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:23.022994 14945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:23.022995 14948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:23.023237 14940 server_base.cc:1034] running on GCE node
I20260619 02:44:23.023416 14940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:23.023645 14940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:23.024797 14940 hybrid_clock.cc:648] HybridClock initialized: now 1781837063024790 us; error 36 us; skew 500 ppm
Jun 19 02:44:23 dist-test-slave-fbl4 krb5kdc[14543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837063, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:23.027136 14940 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:23.027539 14940 webserver.cc:460] Webserver started at http://127.12.145.67:41809/ using document root <none> and password file <none>
I20260619 02:44:23.027776 14940 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:23.027839 14940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:23.027979 14940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:23.028968 14940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "1f1101d1904e49779751e96d43f53a4d"
format_stamp: "Formatted at 2026-06-19 02:44:23 on dist-test-slave-fbl4"
server_key: "ff6f324b70cb7f050b3fbf8fd9285c98"
server_key_iv: "095fa78908f6b93bb77bf74b3212aeee"
server_key_version: "encryptionkey@0"
I20260619 02:44:23.029323 14940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "1f1101d1904e49779751e96d43f53a4d"
format_stamp: "Formatted at 2026-06-19 02:44:23 on dist-test-slave-fbl4"
server_key: "ff6f324b70cb7f050b3fbf8fd9285c98"
server_key_iv: "095fa78908f6b93bb77bf74b3212aeee"
server_key_version: "encryptionkey@0"
I20260619 02:44:23.030582 14940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:44:23.031250 14955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:23.031407 14940 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:23.031497 14940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "1f1101d1904e49779751e96d43f53a4d"
format_stamp: "Formatted at 2026-06-19 02:44:23 on dist-test-slave-fbl4"
server_key: "ff6f324b70cb7f050b3fbf8fd9285c98"
server_key_iv: "095fa78908f6b93bb77bf74b3212aeee"
server_key_version: "encryptionkey@0"
I20260619 02:44:23.031575 14940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:23.061646 14940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:23.063983 14940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:23.064131 14940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:23.064611 14940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:23.064668 14940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:23.064713 14940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:23.064739 14940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 02:44:23 dist-test-slave-fbl4 krb5kdc[14543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837063, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:23.071679 14940 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:34871
I20260619 02:44:23.071761 15070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:34871 every 8 connection(s)
I20260619 02:44:23.072050 14940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:44:23.074047 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.065098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:41177 (local address 127.12.145.126:36595)
0619 02:44:23.065163 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.065165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.065400 (+ 235us) server_negotiation.cc:407] Connection header received
0619 02:44:23.065847 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.065848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.065861 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.065936 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:23.066739 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.067213 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.068189 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.068427 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.068507 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.071020 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:23.071021 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:23.071022 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:23.071030 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:23.072708 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.073104 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.073106 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.073107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.073167 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.073426 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.073427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.073428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.073544 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:23.073617 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.073877 (+ 260us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.073957 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:44:23.074222 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.065095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36595 (local address 127.12.145.67:41177)
0619 02:44:23.065261 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.065298 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.065758 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.066019 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.066022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.066355 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:23.066641 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.066646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.067297 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.067298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.068071 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.068073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.068515 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.068516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.068650 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.069095 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:23.069108 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:23.070942 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:23.072797 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:23.072802 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:23.072804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:23.073023 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:23.073249 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:23.073250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:23.073250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:23.073363 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:23.073607 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:23.073612 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:23.073753 (+ 141us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.073856 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.074003 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":108,"threads_started":1}
I20260619 02:44:23.074729 15071 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36595
I20260619 02:44:23.074810 15071 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:23.074987 15071 heartbeater.cc:511] Master 127.12.145.126:36595 requested a full tablet report, sending...
I20260619 02:44:23.075346 14587 ts_manager.cc:194] Registered new tserver with Master: 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:23.075803 14587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:41177
I20260619 02:44:23.079994 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 14940
I20260619 02:44:23.080120 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:23.080320 12869 external_mini_cluster.cc:1428] Setting key d54518615ae1552f211595a5f30276b2
I20260619 02:44:23.080675 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.075735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:51811 (local address 127.12.145.126:36595)
0619 02:44:23.075772 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.075774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.075869 (+ 95us) server_negotiation.cc:407] Connection header received
0619 02:44:23.075962 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.075963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.075973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.076027 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:23.076338 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.076790 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.077478 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.077668 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.077740 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.078474 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:23.078475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:23.078476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:23.078482 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:23.079572 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.079935 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.079936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.079936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.079988 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.080178 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.080179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.080179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.080297 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:23.080350 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.080511 (+ 161us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.080588 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:44:23.080711 15077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.075687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36595 (local address 127.12.145.67:51811)
0619 02:44:23.075809 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.075818 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.075882 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.076025 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.076027 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.076212 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:23.076263 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.076264 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.076875 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.076876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.077380 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.077381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.077746 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.077747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.077819 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.078146 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:23.078150 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:23.078393 (+ 243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:23.079663 (+ 1270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:23.079664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:23.079664 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:23.079869 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:23.080049 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:23.080050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:23.080050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:23.080121 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:23.080358 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:23.080359 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:23.080407 (+ 48us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.080481 (+ 74us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.080587 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260619 02:44:23.081532 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 02:44:23 dist-test-slave-fbl4 krb5kdc[14543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 02:44:23 dist-test-slave-fbl4 krb5kdc[14543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:23.102936 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.096527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39348 (local address 127.12.145.126:36595)
0619 02:44:23.096584 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.096585 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.096593 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:23.096644 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.096645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.096653 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.096710 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:23.097210 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.097666 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.098341 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.098510 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.098602 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.100586 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:23.100587 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:23.100587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:23.100594 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:23.101814 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.102114 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.102114 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.102115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.102176 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.102338 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.102339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.102339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.102485 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:23.102608 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.102752 (+ 144us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.102829 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:44:23.104488 14587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:44:23.106005 14587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:23.112003 15087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.108026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33263 (local address 127.0.0.1:47532)
0619 02:44:23.108184 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.108229 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.108309 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.108626 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.108627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.108629 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:23.108715 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.108717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.109626 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.109627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.110828 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.110831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.111695 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.111695 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.111774 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.111786 (+ 12us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.111877 (+ 91us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.111926 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":2,"thread_start_us":56,"threads_started":1}
I20260619 02:44:23.112026 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.108339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47532 (local address 127.12.145.65:33263)
0619 02:44:23.108468 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.108473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.108482 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:23.108517 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.108519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.108536 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.108621 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:23.108810 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.109543 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.110903 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.111615 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.111689 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.111749 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.111895 (+ 146us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.111935 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
I20260619 02:44:23.112325 15085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.108026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:38385 (local address 127.0.0.1:53770)
0619 02:44:23.108253 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.108264 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.108317 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.108889 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.108890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.108891 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:23.108928 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.108929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.110149 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.110150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.111153 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.111155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.112042 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.112042 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.112108 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.112112 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.112167 (+ 55us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.112236 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":2,"thread_start_us":50,"threads_started":1}
I20260619 02:44:23.112478 15088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.108165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51838 (local address 127.12.145.67:34871)
0619 02:44:23.108440 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.108445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.108456 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:44:23.108510 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.108512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.108526 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.108616 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:23.108873 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.109948 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.111155 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.111866 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.111941 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.111995 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.112344 (+ 349us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.112388 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":73,"threads_started":1}
I20260619 02:44:23.112562 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.108252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.12.145.66:38385)
0619 02:44:23.108729 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.108733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.108742 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:23.108776 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.108778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.108793 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.108993 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:23.109050 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.110068 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.111219 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.111913 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.111971 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.112015 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.112430 (+ 415us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.112475 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":74,"threads_started":1}
I20260619 02:44:23.112743 15086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.108028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:34871 (local address 127.0.0.1:51838)
0619 02:44:23.108403 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.108412 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.108450 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.108623 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.108626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.108628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:23.108717 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.108720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.110031 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.110032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.111052 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.111054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.112031 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.112032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.112262 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.112265 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.112313 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.112346 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":8,"thread_start_us":61,"threads_started":1}
I20260619 02:44:23.112767 14725 tablet_service.cc:1467] Processing CreateTablet for tablet 015ab34aa16145dd9e33f2472a4d5511 (DEFAULT_TABLE table=test-table [id=2f969d74a53f44f8b5c2a19c47f15e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:23.113148 14725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015ab34aa16145dd9e33f2472a4d5511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.113402 15005 tablet_service.cc:1467] Processing CreateTablet for tablet 015ab34aa16145dd9e33f2472a4d5511 (DEFAULT_TABLE table=test-table [id=2f969d74a53f44f8b5c2a19c47f15e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:23.113690 15005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015ab34aa16145dd9e33f2472a4d5511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.115303 14865 tablet_service.cc:1467] Processing CreateTablet for tablet 015ab34aa16145dd9e33f2472a4d5511 (DEFAULT_TABLE table=test-table [id=2f969d74a53f44f8b5c2a19c47f15e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:23.115614 14865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 015ab34aa16145dd9e33f2472a4d5511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.116173 15091 tablet_bootstrap.cc:492] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Bootstrap starting.
I20260619 02:44:23.116545 15092 tablet_bootstrap.cc:492] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Bootstrap starting.
I20260619 02:44:23.116951 15091 tablet_bootstrap.cc:654] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.117300 15091 log.cc:824] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:23.117404 15092 tablet_bootstrap.cc:654] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.117697 15092 log.cc:824] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:23.118376 15092 tablet_bootstrap.cc:492] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: No bootstrap required, opened a new log
I20260619 02:44:23.118376 15091 tablet_bootstrap.cc:492] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: No bootstrap required, opened a new log
I20260619 02:44:23.118446 15092 ts_tablet_manager.cc:1397] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:23.118446 15091 ts_tablet_manager.cc:1397] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:23.118919 15095 tablet_bootstrap.cc:492] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Bootstrap starting.
I20260619 02:44:23.119593 15095 tablet_bootstrap.cc:654] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.119874 15095 log.cc:824] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:23.120481 15095 tablet_bootstrap.cc:492] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: No bootstrap required, opened a new log
I20260619 02:44:23.120391 15091 raft_consensus.cc:348] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.120391 15092 raft_consensus.cc:348] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.120543 15092 raft_consensus.cc:374] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.120543 15091 raft_consensus.cc:374] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.120556 15095 ts_tablet_manager.cc:1397] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:23.120584 15092 raft_consensus.cc:729] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1101d1904e49779751e96d43f53a4d, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.120584 15091 raft_consensus.cc:729] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aefd7bd3cd4e809437cf5dbebf5203, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.120698 15091 consensus_queue.cc:260] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.120690 15092 consensus_queue.cc:260] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.120965 15092 ts_tablet_manager.cc:1428] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 02:44:23.120965 15091 ts_tablet_manager.cc:1428] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:44:23.120995 15071 heartbeater.cc:503] Master 127.12.145.126:36595 was elected leader, sending a full tablet report...
I20260619 02:44:23.121073 14791 heartbeater.cc:503] Master 127.12.145.126:36595 was elected leader, sending a full tablet report...
I20260619 02:44:23.122892 15095 raft_consensus.cc:348] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.123037 15095 raft_consensus.cc:374] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.123080 15095 raft_consensus.cc:729] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.123185 15095 consensus_queue.cc:260] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.123430 15095 ts_tablet_manager.cc:1428] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:44:23.123500 14931 heartbeater.cc:503] Master 127.12.145.126:36595 was elected leader, sending a full tablet report...
I20260619 02:44:23.152470 15099 raft_consensus.cc:482] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:23.152576 15099 raft_consensus.cc:504] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.152899 15099 leader_election.cc:288] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:23.155769 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.153153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:54725 (local address 127.12.145.65:33263)
0619 02:44:23.153199 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.153201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.153210 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:23.153242 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.153242 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.153254 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.153325 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:23.153495 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.154054 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.155066 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.155434 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.155516 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.155524 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.155662 (+ 138us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.155699 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:44:23.155784 15088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.153158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:41435 (local address 127.12.145.67:34871)
0619 02:44:23.153210 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.153211 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.153333 (+ 122us) server_negotiation.cc:407] Connection header received
0619 02:44:23.153381 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.153382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.153392 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.153451 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:23.153647 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.154099 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.155103 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.155433 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.155511 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.155520 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.155688 (+ 168us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.155720 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260619 02:44:23.155784 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.153049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33263 (local address 127.12.145.66:54725)
0619 02:44:23.153129 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.153141 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.153184 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.153342 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.153343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.153345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:23.153422 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.153424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.154127 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.154127 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.154978 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.154980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.155511 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.155512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.155590 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.155593 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.155634 (+ 41us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.155688 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":18}
I20260619 02:44:23.155798 15100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.153078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:34871 (local address 127.12.145.66:41435)
0619 02:44:23.153260 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.153269 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.153325 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.153473 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.153474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.153476 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:23.153578 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.153580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.154177 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.154178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.154994 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.154996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.155522 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.155523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.155600 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.155603 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.155675 (+ 72us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.155710 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":117,"threads_started":1}
I20260619 02:44:23.156132 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015ab34aa16145dd9e33f2472a4d5511" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" is_pre_election: true
I20260619 02:44:23.156297 14745 raft_consensus.cc:2454] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 0.
I20260619 02:44:23.156358 15025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015ab34aa16145dd9e33f2472a4d5511" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d" is_pre_election: true
I20260619 02:44:23.156488 15025 raft_consensus.cc:2454] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 0.
I20260619 02:44:23.156523 14816 leader_election.cc:302] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d03fdc8204f9288e3a7644eefb4d0, 93aefd7bd3cd4e809437cf5dbebf5203; no voters:
I20260619 02:44:23.156667 15099 raft_consensus.cc:2781] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:23.156735 15099 raft_consensus.cc:482] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:23.156761 15099 raft_consensus.cc:3037] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.157416 15099 raft_consensus.cc:504] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.157557 15099 leader_election.cc:288] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 election: Requested vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:23.157696 15025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015ab34aa16145dd9e33f2472a4d5511" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d"
I20260619 02:44:23.157722 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "015ab34aa16145dd9e33f2472a4d5511" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203"
I20260619 02:44:23.157773 15025 raft_consensus.cc:3037] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.157816 14745 raft_consensus.cc:3037] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.158424 15025 raft_consensus.cc:2454] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 1.
I20260619 02:44:23.158583 14745 raft_consensus.cc:2454] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 1.
I20260619 02:44:23.158639 14818 leader_election.cc:302] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1101d1904e49779751e96d43f53a4d, 4f2d03fdc8204f9288e3a7644eefb4d0; no voters:
I20260619 02:44:23.158715 15099 raft_consensus.cc:2781] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:23.158885 15099 raft_consensus.cc:686] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Running, Role: LEADER
I20260619 02:44:23.158982 15099 consensus_queue.cc:237] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } }
I20260619 02:44:23.159701 14587 catalog_manager.cc:5495] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } health_report { overall_health: HEALTHY } } }
W20260619 02:44:23.160137 14932 tablet.cc:2369] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 19 02:44:23 dist-test-slave-fbl4 krb5kdc[14543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837062, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:23.194201 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.187346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36595 (local address 127.0.0.1:39350)
0619 02:44:23.187534 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.187545 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.187632 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.187783 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.187784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.188085 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:23.188128 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.188131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.188841 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.188843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.189392 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.189394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.189798 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.189799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.189849 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.190405 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:23.190410 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:23.191831 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:23.193129 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:23.193136 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:23.193138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:23.193324 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:23.193540 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:23.193541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:23.193541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:23.193595 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:23.193819 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:23.193825 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:23.193867 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.193939 (+ 72us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.194070 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":110,"threads_started":1}
I20260619 02:44:23.194247 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.187438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39350 (local address 127.12.145.126:36595)
0619 02:44:23.187526 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.187529 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.187612 (+ 83us) server_negotiation.cc:407] Connection header received
0619 02:44:23.187691 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.187692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.187702 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.187778 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:23.188207 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.188766 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.189490 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.189715 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.189799 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.191921 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:23.191922 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:23.191922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:23.191928 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:23.193040 (+ 1112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.193403 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.193404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.193405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.193470 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:23.193648 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:23.193649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:23.193650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:23.193759 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:23.193828 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.193971 (+ 143us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.194131 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":59}
I20260619 02:44:23.196323 14587 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:39350:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 02:44:23.196540 14587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:23.197923 14865 tablet_service.cc:1467] Processing CreateTablet for tablet db584e9526fd425ea4685e4b59de5e76 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=edb80365fc5a4018a88e8775cc6a1a42]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:44:23.197964 15005 tablet_service.cc:1467] Processing CreateTablet for tablet db584e9526fd425ea4685e4b59de5e76 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=edb80365fc5a4018a88e8775cc6a1a42]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:44:23.198083 14865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db584e9526fd425ea4685e4b59de5e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.198138 15005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db584e9526fd425ea4685e4b59de5e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.198710 14725 tablet_service.cc:1467] Processing CreateTablet for tablet db584e9526fd425ea4685e4b59de5e76 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=edb80365fc5a4018a88e8775cc6a1a42]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:44:23.198879 14725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db584e9526fd425ea4685e4b59de5e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.199441 15095 tablet_bootstrap.cc:492] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: Bootstrap starting.
I20260619 02:44:23.199838 15095 tablet_bootstrap.cc:654] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.200361 15091 tablet_bootstrap.cc:492] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: Bootstrap starting.
I20260619 02:44:23.200366 15092 tablet_bootstrap.cc:492] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: Bootstrap starting.
I20260619 02:44:23.200510 15095 tablet_bootstrap.cc:492] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: No bootstrap required, opened a new log
I20260619 02:44:23.200567 15095 ts_tablet_manager.cc:1397] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:23.200807 15095 raft_consensus.cc:348] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.200893 15095 raft_consensus.cc:374] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.200918 15095 raft_consensus.cc:729] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.200971 15092 tablet_bootstrap.cc:654] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.200975 15095 consensus_queue.cc:260] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.201033 15091 tablet_bootstrap.cc:654] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.201082 15095 ts_tablet_manager.cc:1428] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:23.201205 15099 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.201287 15099 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:23.201725 15091 tablet_bootstrap.cc:492] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: No bootstrap required, opened a new log
I20260619 02:44:23.201779 15091 ts_tablet_manager.cc:1397] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:23.201896 15092 tablet_bootstrap.cc:492] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: No bootstrap required, opened a new log
I20260619 02:44:23.201956 15092 ts_tablet_manager.cc:1397] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260619 02:44:23.201920 15091 raft_consensus.cc:348] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.201999 15091 raft_consensus.cc:374] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.202030 15091 raft_consensus.cc:729] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aefd7bd3cd4e809437cf5dbebf5203, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.202097 15091 consensus_queue.cc:260] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.202112 15092 raft_consensus.cc:348] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.202198 15092 raft_consensus.cc:374] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.202201 15091 ts_tablet_manager.cc:1428] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:23.202221 15092 raft_consensus.cc:729] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1101d1904e49779751e96d43f53a4d, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.202260 15092 consensus_queue.cc:260] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.202270 15097 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.202353 15092 ts_tablet_manager.cc:1428] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:23.202348 15097 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:23.202491 15098 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.202622 15098 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:23.203553 15099 raft_consensus.cc:482] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:23.203629 15099 raft_consensus.cc:504] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.203749 15099 leader_election.cc:288] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:23.203887 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db584e9526fd425ea4685e4b59de5e76" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" is_pre_election: true
I20260619 02:44:23.203963 14745 raft_consensus.cc:2454] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 0.
I20260619 02:44:23.203972 15025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db584e9526fd425ea4685e4b59de5e76" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d" is_pre_election: true
I20260619 02:44:23.204056 15025 raft_consensus.cc:2454] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 0.
I20260619 02:44:23.204072 14816 leader_election.cc:302] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d03fdc8204f9288e3a7644eefb4d0, 93aefd7bd3cd4e809437cf5dbebf5203; no voters:
I20260619 02:44:23.204164 15099 raft_consensus.cc:2781] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:23.204219 15099 raft_consensus.cc:482] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:23.204249 15099 raft_consensus.cc:3037] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.204732 15099 raft_consensus.cc:504] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.204847 15099 leader_election.cc:288] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 election: Requested vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:23.205004 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db584e9526fd425ea4685e4b59de5e76" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203"
I20260619 02:44:23.205044 15025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db584e9526fd425ea4685e4b59de5e76" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d"
I20260619 02:44:23.205058 14745 raft_consensus.cc:3037] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.205112 15025 raft_consensus.cc:3037] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.205600 15025 raft_consensus.cc:2454] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 1.
I20260619 02:44:23.205670 14745 raft_consensus.cc:2454] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 1.
I20260619 02:44:23.205749 14818 leader_election.cc:302] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1101d1904e49779751e96d43f53a4d, 4f2d03fdc8204f9288e3a7644eefb4d0; no voters:
I20260619 02:44:23.205843 15099 raft_consensus.cc:2781] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:23.205895 15099 raft_consensus.cc:686] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Running, Role: LEADER
I20260619 02:44:23.205938 15099 consensus_queue.cc:237] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.206192 15101 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: TxnStatusTablet state changed. Reason: New leader 4f2d03fdc8204f9288e3a7644eefb4d0. Latest consensus state: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.206266 15101 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:44:23.206445 15113 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 02:44:23.206585 15113 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 02:44:23.206634 14588 catalog_manager.cc:5495] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } health_report { overall_health: UNKNOWN } } }
I20260619 02:44:23.213622 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.211172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53776 (local address 127.12.145.66:38385)
0619 02:44:23.211229 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.211231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.211243 (+ 12us) server_negotiation.cc:407] Connection header received
0619 02:44:23.211327 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.211328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.211343 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.211395 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:23.211501 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.212077 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.212860 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.213061 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.213138 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.213316 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:23.213415 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:23.213498 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.213539 (+ 41us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.213559 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:44:23.213650 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.211106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:38385 (local address 127.0.0.1:53776)
0619 02:44:23.211202 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.211214 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.211261 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.211407 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.211408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.211409 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:23.211453 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.211455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.212163 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.212164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.212776 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.212778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.213139 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.213140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.213210 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.213222 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:23.213477 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:23.213485 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.213533 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.213578 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260619 02:44:23.215435 15025 raft_consensus.cc:1261] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Refusing update from remote peer 4f2d03fdc8204f9288e3a7644eefb4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:23.215474 14745 raft_consensus.cc:1261] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Refusing update from remote peer 4f2d03fdc8204f9288e3a7644eefb4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:23.215740 15099 consensus_queue.cc:1035] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:23.215821 15101 consensus_queue.cc:1035] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:23.217024 15097 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: TxnStatusTablet state changed. Reason: New leader 4f2d03fdc8204f9288e3a7644eefb4d0. Latest consensus state: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.217021 15098 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: TxnStatusTablet state changed. Reason: New leader 4f2d03fdc8204f9288e3a7644eefb4d0. Latest consensus state: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.217126 15098 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:23.217128 15097 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:23.218170 15099 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.218263 15099 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:44:23.218360 15098 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.218431 15098 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 1f1101d1904e49779751e96d43f53a4d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:23.218631 15116 mvcc.cc:205] Tried to move back new op lower bound from 7298404610928111616 to 7298404610891767808. Current Snapshot: MvccSnapshot[applied={T|T < 7298404610928111616}]
I20260619 02:44:23.219168 15101 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.219251 15101 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 4f2d03fdc8204f9288e3a7644eefb4d0: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:44:23.220134 15097 tablet_replica.cc:439] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } } }
I20260619 02:44:23.220213 15097 tablet_replica.cc:442] T db584e9526fd425ea4685e4b59de5e76 P 93aefd7bd3cd4e809437cf5dbebf5203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:44:23.223176 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.220847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53790 (local address 127.12.145.66:38385)
0619 02:44:23.220884 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.220886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.220894 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:23.220953 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.220954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.220960 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.221007 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:23.221142 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.221557 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.222641 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.222817 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.222865 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.223008 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:23.223029 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:23.223064 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.223120 (+ 56us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.223134 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:44:23.227552 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.225365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:34071 (local address 127.12.145.66:38385)
0619 02:44:23.225416 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:23.225418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:23.225426 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:23.225481 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:23.225482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:23.225491 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:23.225551 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:23.225688 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.226102 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.226915 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.227079 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.227151 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.227312 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:23.227343 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:23.227398 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:23.227450 (+ 52us) server_negotiation.cc:299] Negotiation successful
0619 02:44:23.227464 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":36}
I20260619 02:44:23.227558 14937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:23.225313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:38385 (local address 127.12.145.66:34071)
0619 02:44:23.225375 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:23.225386 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:23.225425 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:23.225551 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:23.225552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:23.225553 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:23.225608 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.225609 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.226172 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.226173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.226829 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:23.226832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:23.227152 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:23.227153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:23.227219 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:23.227230 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:23.227400 (+ 170us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:23.227401 (+ 1us) client_negotiation.cc:769] Sending connection context
0619 02:44:23.227448 (+ 47us) client_negotiation.cc:240] Negotiation successful
0619 02:44:23.227483 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260619 02:44:23.229389 14745 raft_consensus.cc:1261] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Refusing update from remote peer 4f2d03fdc8204f9288e3a7644eefb4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:23.229389 15025 raft_consensus.cc:1261] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Refusing update from remote peer 4f2d03fdc8204f9288e3a7644eefb4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:23.229578 15123 consensus_queue.cc:1035] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:23.229647 15101 consensus_queue.cc:1035] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:23.231043 15118 mvcc.cc:205] Tried to move back new op lower bound from 7298404610986360832 to 7298404610699857920. Current Snapshot: MvccSnapshot[applied={T|T < 7298404610986360832}]
I20260619 02:44:23.231669 15117 mvcc.cc:205] Tried to move back new op lower bound from 7298404610986360832 to 7298404610699857920. Current Snapshot: MvccSnapshot[applied={T|T < 7298404610986360832}]
I20260619 02:44:23.241223 14588 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:23.241328 14588 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:23.242018 14588 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Sending DeleteTablet for 3 replicas of tablet 015ab34aa16145dd9e33f2472a4d5511
I20260619 02:44:23.242291 15005 tablet_service.cc:1514] Processing DeleteTablet for tablet 015ab34aa16145dd9e33f2472a4d5511 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:23 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:51838
I20260619 02:44:23.242281 14725 tablet_service.cc:1514] Processing DeleteTablet for tablet 015ab34aa16145dd9e33f2472a4d5511 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:23 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:47532
I20260619 02:44:23.242523 15132 tablet_replica.cc:330] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: stopping tablet replica
I20260619 02:44:23.242575 14865 tablet_service.cc:1514] Processing DeleteTablet for tablet 015ab34aa16145dd9e33f2472a4d5511 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:23 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:53770
I20260619 02:44:23.242635 15131 tablet_replica.cc:330] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: stopping tablet replica
I20260619 02:44:23.242729 15131 raft_consensus.cc:2229] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:23.242750 15132 raft_consensus.cc:2229] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:23.242777 14588 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 02:44:23.242877 15131 raft_consensus.cc:2258] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 02:44:23.242914 14588 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:23.243050 15132 raft_consensus.cc:2258] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:23.243167 15133 tablet_replica.cc:330] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: stopping tablet replica
I20260619 02:44:23.243263 15133 raft_consensus.cc:2229] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:23.243353 15133 raft_consensus.cc:2258] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:23.243665 15132 ts_tablet_manager.cc:1905] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:23.243985 15133 ts_tablet_manager.cc:1905] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:23.244169 14725 tablet_service.cc:1467] Processing CreateTablet for tablet 1eba2ccd277f45eab6f4f81414fd117f (DEFAULT_TABLE table=test-table [id=ed07f5bfae114f24b9e3c3501732c5fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:23.244226 15005 tablet_service.cc:1467] Processing CreateTablet for tablet 1eba2ccd277f45eab6f4f81414fd117f (DEFAULT_TABLE table=test-table [id=ed07f5bfae114f24b9e3c3501732c5fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:23.244279 14725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eba2ccd277f45eab6f4f81414fd117f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.244313 15005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eba2ccd277f45eab6f4f81414fd117f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.245577 15092 tablet_bootstrap.cc:492] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Bootstrap starting.
I20260619 02:44:23.245608 15091 tablet_bootstrap.cc:492] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Bootstrap starting.
I20260619 02:44:23.245813 15133 ts_tablet_manager.cc:1918] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:23.245873 15133 log.cc:1196] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/015ab34aa16145dd9e33f2472a4d5511
I20260619 02:44:23.245991 15091 tablet_bootstrap.cc:654] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.245991 15092 tablet_bootstrap.cc:654] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.246126 15133 ts_tablet_manager.cc:1939] T 015ab34aa16145dd9e33f2472a4d5511 P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting consensus metadata
I20260619 02:44:23.246658 14865 tablet_service.cc:1467] Processing CreateTablet for tablet 1eba2ccd277f45eab6f4f81414fd117f (DEFAULT_TABLE table=test-table [id=ed07f5bfae114f24b9e3c3501732c5fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:23.246757 14865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eba2ccd277f45eab6f4f81414fd117f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:23.246812 14573 catalog_manager.cc:4841] TS 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385): tablet 015ab34aa16145dd9e33f2472a4d5511 (table test-table [id=2f969d74a53f44f8b5c2a19c47f15e64]) successfully deleted
I20260619 02:44:23.247144 15131 ts_tablet_manager.cc:1905] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:23.247959 15095 tablet_bootstrap.cc:492] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: Bootstrap starting.
I20260619 02:44:23.248237 15132 ts_tablet_manager.cc:1918] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:23.248351 15132 log.cc:1196] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/015ab34aa16145dd9e33f2472a4d5511
I20260619 02:44:23.248365 15095 tablet_bootstrap.cc:654] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:23.248696 15132 ts_tablet_manager.cc:1939] T 015ab34aa16145dd9e33f2472a4d5511 P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting consensus metadata
I20260619 02:44:23.248783 15131 ts_tablet_manager.cc:1918] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:23.248852 15131 log.cc:1196] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/015ab34aa16145dd9e33f2472a4d5511
I20260619 02:44:23.248960 15092 tablet_bootstrap.cc:492] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: No bootstrap required, opened a new log
I20260619 02:44:23.249017 15092 ts_tablet_manager.cc:1397] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260619 02:44:23.249097 15131 ts_tablet_manager.cc:1939] T 015ab34aa16145dd9e33f2472a4d5511 P 1f1101d1904e49779751e96d43f53a4d: Deleting consensus metadata
I20260619 02:44:23.249166 15092 raft_consensus.cc:348] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.249236 15092 raft_consensus.cc:374] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.249262 15092 raft_consensus.cc:729] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1101d1904e49779751e96d43f53a4d, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.249301 15092 consensus_queue.cc:260] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.249390 15092 ts_tablet_manager.cc:1428] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:23.249480 14574 catalog_manager.cc:4841] TS 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871): tablet 015ab34aa16145dd9e33f2472a4d5511 (table test-table [id=2f969d74a53f44f8b5c2a19c47f15e64]) successfully deleted
I20260619 02:44:23.249554 14572 catalog_manager.cc:4841] TS 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263): tablet 015ab34aa16145dd9e33f2472a4d5511 (table test-table [id=2f969d74a53f44f8b5c2a19c47f15e64]) successfully deleted
I20260619 02:44:23.250062 15091 tablet_bootstrap.cc:492] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: No bootstrap required, opened a new log
I20260619 02:44:23.250131 15091 ts_tablet_manager.cc:1397] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260619 02:44:23.250247 15095 tablet_bootstrap.cc:492] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: No bootstrap required, opened a new log
I20260619 02:44:23.250289 15095 ts_tablet_manager.cc:1397] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:23.250273 15091 raft_consensus.cc:348] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.250337 15091 raft_consensus.cc:374] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.250370 15091 raft_consensus.cc:729] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aefd7bd3cd4e809437cf5dbebf5203, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.250406 15091 consensus_queue.cc:260] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.250411 15095 raft_consensus.cc:348] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.250468 15095 raft_consensus.cc:374] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:23.250488 15095 raft_consensus.cc:729] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Initialized, Role: FOLLOWER
I20260619 02:44:23.250494 15091 ts_tablet_manager.cc:1428] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:23.250530 15095 consensus_queue.cc:260] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.250658 15095 ts_tablet_manager.cc:1428] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260619 02:44:23.260974 14792 tablet.cc:2369] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:44:23.322630 15072 tablet.cc:2369] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:44:23.495508 15099 raft_consensus.cc:482] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:23.495630 15099 raft_consensus.cc:504] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.495836 15099 leader_election.cc:288] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:23.496060 15025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eba2ccd277f45eab6f4f81414fd117f" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d" is_pre_election: true
I20260619 02:44:23.496047 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eba2ccd277f45eab6f4f81414fd117f" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" is_pre_election: true
I20260619 02:44:23.496142 14745 raft_consensus.cc:2454] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 0.
I20260619 02:44:23.496157 15025 raft_consensus.cc:2454] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 0.
I20260619 02:44:23.496290 14816 leader_election.cc:302] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d03fdc8204f9288e3a7644eefb4d0, 93aefd7bd3cd4e809437cf5dbebf5203; no voters:
I20260619 02:44:23.496403 15099 raft_consensus.cc:2781] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:23.496443 15099 raft_consensus.cc:482] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:23.496464 15099 raft_consensus.cc:3037] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.497089 15099 raft_consensus.cc:504] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.497218 15099 leader_election.cc:288] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 election: Requested vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:23.497383 15025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eba2ccd277f45eab6f4f81414fd117f" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d"
I20260619 02:44:23.497445 15025 raft_consensus.cc:3037] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.498051 15025 raft_consensus.cc:2454] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 1.
I20260619 02:44:23.498163 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eba2ccd277f45eab6f4f81414fd117f" candidate_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203"
I20260619 02:44:23.498204 14818 leader_election.cc:302] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1101d1904e49779751e96d43f53a4d, 4f2d03fdc8204f9288e3a7644eefb4d0; no voters:
I20260619 02:44:23.498255 14745 raft_consensus.cc:3037] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:23.498348 15099 raft_consensus.cc:2781] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:23.498413 15099 raft_consensus.cc:686] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Running, Role: LEADER
I20260619 02:44:23.498463 15099 consensus_queue.cc:237] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:23.499075 14745 raft_consensus.cc:2454] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f2d03fdc8204f9288e3a7644eefb4d0 in term 1.
I20260619 02:44:23.499054 14588 catalog_manager.cc:5495] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } health_report { overall_health: UNKNOWN } } }
I20260619 02:44:23.533423 14745 raft_consensus.cc:1261] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Refusing update from remote peer 4f2d03fdc8204f9288e3a7644eefb4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:23.533471 15025 raft_consensus.cc:1261] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Refusing update from remote peer 4f2d03fdc8204f9288e3a7644eefb4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:23.533654 15101 consensus_queue.cc:1035] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:23.533754 15123 consensus_queue.cc:1035] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 02:44:23.537935 15116 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260619 02:44:25.054567 14587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:25.054663 14587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:25.055451 14587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Sending DeleteTablet for 3 replicas of tablet 1eba2ccd277f45eab6f4f81414fd117f
I20260619 02:44:25.055684 14725 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eba2ccd277f45eab6f4f81414fd117f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:25 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:47532
I20260619 02:44:25.055708 15005 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eba2ccd277f45eab6f4f81414fd117f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:25 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:51838
I20260619 02:44:25.055872 14864 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eba2ccd277f45eab6f4f81414fd117f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:25 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:53770
I20260619 02:44:25.056053 15162 tablet_replica.cc:330] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: stopping tablet replica
I20260619 02:44:25.056056 15161 tablet_replica.cc:330] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: stopping tablet replica
I20260619 02:44:25.056126 15162 raft_consensus.cc:2229] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:25.056128 15161 raft_consensus.cc:2229] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:25.056185 15161 raft_consensus.cc:2258] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:25.056188 15162 raft_consensus.cc:2258] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:25.056433 15162 ts_tablet_manager.cc:1905] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:25.056445 15161 ts_tablet_manager.cc:1905] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:25.057922 15162 ts_tablet_manager.cc:1918] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 02:44:25.058041 15162 log.cc:1196] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/1eba2ccd277f45eab6f4f81414fd117f
I20260619 02:44:25.058257 15161 ts_tablet_manager.cc:1918] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 02:44:25.058372 15162 ts_tablet_manager.cc:1939] T 1eba2ccd277f45eab6f4f81414fd117f P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting consensus metadata
I20260619 02:44:25.058377 15161 log.cc:1196] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/1eba2ccd277f45eab6f4f81414fd117f
I20260619 02:44:25.058645 15161 ts_tablet_manager.cc:1939] T 1eba2ccd277f45eab6f4f81414fd117f P 1f1101d1904e49779751e96d43f53a4d: Deleting consensus metadata
I20260619 02:44:25.058681 14573 catalog_manager.cc:4841] TS 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385): tablet 1eba2ccd277f45eab6f4f81414fd117f (table test-table [id=ed07f5bfae114f24b9e3c3501732c5fd]) successfully deleted
I20260619 02:44:25.058702 15160 tablet_replica.cc:330] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: stopping tablet replica
I20260619 02:44:25.058758 15160 raft_consensus.cc:2229] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:25.058799 15160 raft_consensus.cc:2258] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:25.058951 14574 catalog_manager.cc:4841] TS 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871): tablet 1eba2ccd277f45eab6f4f81414fd117f (table test-table [id=ed07f5bfae114f24b9e3c3501732c5fd]) successfully deleted
I20260619 02:44:25.059060 15160 ts_tablet_manager.cc:1905] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:25.060837 15160 ts_tablet_manager.cc:1918] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 02:44:25.060956 15160 log.cc:1196] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/1eba2ccd277f45eab6f4f81414fd117f
I20260619 02:44:25.061240 15160 ts_tablet_manager.cc:1939] T 1eba2ccd277f45eab6f4f81414fd117f P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting consensus metadata
I20260619 02:44:25.061549 14572 catalog_manager.cc:4841] TS 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263): tablet 1eba2ccd277f45eab6f4f81414fd117f (table test-table [id=ed07f5bfae114f24b9e3c3501732c5fd]) successfully deleted
Jun 19 02:44:25 dist-test-slave-fbl4 krb5kdc[14543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837065, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 02:44:25 dist-test-slave-fbl4 krb5kdc[14543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837065, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:25.080717 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.073716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51912 (local address 127.12.145.126:36595)
0619 02:44:25.073847 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.073849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.073857 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:25.073924 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.073924 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.073933 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.073992 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:25.074639 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.075201 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.075966 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.076147 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.076195 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.078271 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:25.078272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:25.078272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:25.078278 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:25.079789 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:25.080079 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:25.080079 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:25.080080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:25.080128 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:25.080287 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:25.080287 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:25.080288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:25.080390 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:25.080462 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.080550 (+ 88us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.080610 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":84,"threads_started":1}
I20260619 02:44:25.081907 14587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:44:25.082041 14587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:25.083262 14864 tablet_service.cc:1467] Processing CreateTablet for tablet 9a6fc092a88f47f8b9910bb178185b44 (DEFAULT_TABLE table=test-table [id=e4072f5fd8a847ed8ba091de8b5fc608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:25.083261 15005 tablet_service.cc:1467] Processing CreateTablet for tablet 9a6fc092a88f47f8b9910bb178185b44 (DEFAULT_TABLE table=test-table [id=e4072f5fd8a847ed8ba091de8b5fc608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:25.083390 15005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a6fc092a88f47f8b9910bb178185b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:25.083390 14864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a6fc092a88f47f8b9910bb178185b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:25.084362 15171 tablet_bootstrap.cc:492] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: Bootstrap starting.
I20260619 02:44:25.084487 14725 tablet_service.cc:1467] Processing CreateTablet for tablet 9a6fc092a88f47f8b9910bb178185b44 (DEFAULT_TABLE table=test-table [id=e4072f5fd8a847ed8ba091de8b5fc608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:25.084619 14725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a6fc092a88f47f8b9910bb178185b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:25.084749 15172 tablet_bootstrap.cc:492] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: Bootstrap starting.
I20260619 02:44:25.084794 15171 tablet_bootstrap.cc:654] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:25.085155 15172 tablet_bootstrap.cc:654] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:25.085460 15171 tablet_bootstrap.cc:492] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: No bootstrap required, opened a new log
I20260619 02:44:25.085507 15171 ts_tablet_manager.cc:1397] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:25.085781 15172 tablet_bootstrap.cc:492] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: No bootstrap required, opened a new log
I20260619 02:44:25.085737 15171 raft_consensus.cc:348] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.085814 15171 raft_consensus.cc:374] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:25.085883 15175 tablet_bootstrap.cc:492] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: Bootstrap starting.
I20260619 02:44:25.085892 15172 ts_tablet_manager.cc:1397] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:25.085860 15171 raft_consensus.cc:729] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1101d1904e49779751e96d43f53a4d, State: Initialized, Role: FOLLOWER
I20260619 02:44:25.086033 15172 raft_consensus.cc:348] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.086046 15171 consensus_queue.cc:260] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.086140 15172 raft_consensus.cc:374] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:25.086217 15171 ts_tablet_manager.cc:1428] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260619 02:44:25.086225 15172 raft_consensus.cc:729] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Initialized, Role: FOLLOWER
I20260619 02:44:25.086267 15175 tablet_bootstrap.cc:654] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:25.086350 15172 consensus_queue.cc:260] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.086818 15172 ts_tablet_manager.cc:1428] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260619 02:44:25.087339 15175 tablet_bootstrap.cc:492] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: No bootstrap required, opened a new log
I20260619 02:44:25.087401 15175 ts_tablet_manager.cc:1397] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260619 02:44:25.087538 15175 raft_consensus.cc:348] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.087599 15175 raft_consensus.cc:374] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:25.087612 15175 raft_consensus.cc:729] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aefd7bd3cd4e809437cf5dbebf5203, State: Initialized, Role: FOLLOWER
I20260619 02:44:25.087674 15175 consensus_queue.cc:260] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.087824 15175 ts_tablet_manager.cc:1428] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:25.259919 15176 raft_consensus.cc:482] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:25.260017 15176 raft_consensus.cc:504] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.260362 15176 leader_election.cc:288] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385)
I20260619 02:44:25.263952 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.260610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:56743 (local address 127.12.145.66:38385)
0619 02:44:25.260783 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.260785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.260937 (+ 152us) server_negotiation.cc:407] Connection header received
0619 02:44:25.261000 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.261001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.261011 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.261092 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:25.261280 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.261721 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.262956 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.263569 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.263646 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.263674 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.263824 (+ 150us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.263871 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":106,"threads_started":1}
I20260619 02:44:25.264004 15179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.260553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:38385 (local address 127.12.145.67:56743)
0619 02:44:25.260865 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.260875 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.260933 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.261110 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.261111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.261112 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:25.261217 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.261218 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.261816 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.261817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.262862 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.262865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.263648 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.263649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.263751 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.263754 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.263833 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.263878 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":23,"thread_start_us":107,"threads_started":1}
I20260619 02:44:25.264045 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.260581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:41201 (local address 127.12.145.65:33263)
0619 02:44:25.260755 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.260757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.260839 (+ 82us) server_negotiation.cc:407] Connection header received
0619 02:44:25.260913 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.260914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.260928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.260996 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:25.261164 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.261713 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.263000 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.263588 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.263684 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.263700 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.263917 (+ 217us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.263958 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":91,"threads_started":1}
I20260619 02:44:25.264007 15180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.260520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33263 (local address 127.12.145.67:41201)
0619 02:44:25.260730 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.260761 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.260837 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.261004 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.261005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.261008 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:25.261095 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.261096 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.261792 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.261793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.262924 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.262927 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.263694 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.263695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.263776 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.263779 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.263846 (+ 67us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.263884 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":42,"thread_start_us":115,"threads_started":1}
I20260619 02:44:25.264490 14885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6fc092a88f47f8b9910bb178185b44" candidate_uuid: "1f1101d1904e49779751e96d43f53a4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" is_pre_election: true
I20260619 02:44:25.264631 14885 raft_consensus.cc:2454] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f1101d1904e49779751e96d43f53a4d in term 0.
I20260619 02:44:25.264578 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6fc092a88f47f8b9910bb178185b44" candidate_uuid: "1f1101d1904e49779751e96d43f53a4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" is_pre_election: true
I20260619 02:44:25.264685 14745 raft_consensus.cc:2454] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f1101d1904e49779751e96d43f53a4d in term 0.
I20260619 02:44:25.264827 14957 leader_election.cc:302] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1101d1904e49779751e96d43f53a4d, 4f2d03fdc8204f9288e3a7644eefb4d0; no voters:
I20260619 02:44:25.264966 15176 raft_consensus.cc:2781] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:25.265013 15176 raft_consensus.cc:482] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:25.265040 15176 raft_consensus.cc:3037] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:25.265746 15176 raft_consensus.cc:504] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.265885 15176 leader_election.cc:288] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [CANDIDATE]: Term 1 election: Requested vote from peers 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263), 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385)
I20260619 02:44:25.266008 14745 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6fc092a88f47f8b9910bb178185b44" candidate_uuid: "1f1101d1904e49779751e96d43f53a4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aefd7bd3cd4e809437cf5dbebf5203"
I20260619 02:44:25.266016 14885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a6fc092a88f47f8b9910bb178185b44" candidate_uuid: "1f1101d1904e49779751e96d43f53a4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0"
I20260619 02:44:25.266080 14885 raft_consensus.cc:3037] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:25.266094 14745 raft_consensus.cc:3037] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:25.266750 14885 raft_consensus.cc:2454] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1101d1904e49779751e96d43f53a4d in term 1.
I20260619 02:44:25.266803 14745 raft_consensus.cc:2454] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f1101d1904e49779751e96d43f53a4d in term 1.
I20260619 02:44:25.266894 14957 leader_election.cc:302] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1101d1904e49779751e96d43f53a4d, 4f2d03fdc8204f9288e3a7644eefb4d0; no voters:
I20260619 02:44:25.266975 15176 raft_consensus.cc:2781] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:25.267107 15176 raft_consensus.cc:686] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 1 LEADER]: Becoming Leader. State: Replica: 1f1101d1904e49779751e96d43f53a4d, State: Running, Role: LEADER
I20260619 02:44:25.267182 15176 consensus_queue.cc:237] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.267809 14586 catalog_manager.cc:5495] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f1101d1904e49779751e96d43f53a4d (127.12.145.67). New cstate: current_term: 1 leader_uuid: "1f1101d1904e49779751e96d43f53a4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } health_report { overall_health: HEALTHY } } }
I20260619 02:44:25.314005 15186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.311814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48370 (local address 127.12.145.67:34871)
0619 02:44:25.311957 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.311959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.311967 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:25.312009 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.312010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.312028 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.312098 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:25.312200 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.312680 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.313378 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.313566 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.313616 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.313735 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.313833 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.313883 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.313916 (+ 33us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.313932 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":98,"threads_started":1}
I20260619 02:44:25.318394 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.316111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:48959 (local address 127.12.145.66:38385)
0619 02:44:25.316173 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.316175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.316288 (+ 113us) server_negotiation.cc:407] Connection header received
0619 02:44:25.316348 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.316349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.316360 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.316409 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:25.316531 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.316997 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.317727 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.317942 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.318004 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.318165 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.318195 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.318256 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.318306 (+ 50us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.318326 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:44:25.318415 15189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.316030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:38385 (local address 127.12.145.67:48959)
0619 02:44:25.316218 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.316231 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.316297 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.316417 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.316417 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.316418 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:25.316466 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.316468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.317072 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.317073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.317635 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.317637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.318015 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.318016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.318083 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.318093 (+ 10us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.318257 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.318258 (+ 1us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.318304 (+ 46us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.318342 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
I20260619 02:44:25.320325 14745 raft_consensus.cc:1261] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Refusing update from remote peer 1f1101d1904e49779751e96d43f53a4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:25.320403 14885 raft_consensus.cc:1261] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Refusing update from remote peer 1f1101d1904e49779751e96d43f53a4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:25.320653 15176 consensus_queue.cc:1035] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:25.320792 15183 consensus_queue.cc:1035] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:25.327489 15186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.325283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:41983 (local address 127.12.145.67:34871)
0619 02:44:25.325320 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.325322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.325452 (+ 130us) server_negotiation.cc:407] Connection header received
0619 02:44:25.325515 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.325516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.325524 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.325572 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:25.325646 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.326064 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.326798 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.327031 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.327092 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.327280 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.327310 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.327358 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.327407 (+ 49us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.327426 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:44:25.327517 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.325234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:34871 (local address 127.12.145.66:41983)
0619 02:44:25.325399 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.325409 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.325462 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.325570 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.325570 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.325572 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:25.325610 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.325611 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.326123 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.326123 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.326735 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.326737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.327142 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.327142 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.327186 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.327189 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.327358 (+ 169us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.327360 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.327406 (+ 46us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.327449 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":75,"threads_started":1}
I20260619 02:44:25.334033 14587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:25.334120 14587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:25.334720 14587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Sending DeleteTablet for 3 replicas of tablet 9a6fc092a88f47f8b9910bb178185b44
I20260619 02:44:25.334985 14725 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a6fc092a88f47f8b9910bb178185b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:25 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:47532
I20260619 02:44:25.335033 15005 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a6fc092a88f47f8b9910bb178185b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:25 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:51838
I20260619 02:44:25.335078 15160 tablet_replica.cc:330] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: stopping tablet replica
I20260619 02:44:25.335112 15161 tablet_replica.cc:330] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: stopping tablet replica
I20260619 02:44:25.335120 15160 raft_consensus.cc:2229] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:25.335155 15160 raft_consensus.cc:2258] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:25.335155 15161 raft_consensus.cc:2229] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:25.335229 15161 raft_consensus.cc:2258] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:25.335428 14864 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a6fc092a88f47f8b9910bb178185b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:25 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:53770
I20260619 02:44:25.335525 15162 tablet_replica.cc:330] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: stopping tablet replica
I20260619 02:44:25.335534 15161 ts_tablet_manager.cc:1905] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:25.335577 15162 raft_consensus.cc:2229] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:25.335611 15162 raft_consensus.cc:2258] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:25.335732 15160 ts_tablet_manager.cc:1905] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:25.335867 15162 ts_tablet_manager.cc:1905] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:25.337144 14587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 02:44:25.337280 15160 ts_tablet_manager.cc:1918] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
W20260619 02:44:25.337311 14587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:25.337345 15160 log.cc:1196] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/9a6fc092a88f47f8b9910bb178185b44
I20260619 02:44:25.337363 15162 ts_tablet_manager.cc:1918] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:25.337405 15162 log.cc:1196] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/9a6fc092a88f47f8b9910bb178185b44
I20260619 02:44:25.337554 15160 ts_tablet_manager.cc:1939] T 9a6fc092a88f47f8b9910bb178185b44 P 93aefd7bd3cd4e809437cf5dbebf5203: Deleting consensus metadata
I20260619 02:44:25.337594 15162 ts_tablet_manager.cc:1939] T 9a6fc092a88f47f8b9910bb178185b44 P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting consensus metadata
I20260619 02:44:25.337831 14572 catalog_manager.cc:4841] TS 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263): tablet 9a6fc092a88f47f8b9910bb178185b44 (table test-table [id=e4072f5fd8a847ed8ba091de8b5fc608]) successfully deleted
I20260619 02:44:25.338330 14573 catalog_manager.cc:4841] TS 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385): tablet 9a6fc092a88f47f8b9910bb178185b44 (table test-table [id=e4072f5fd8a847ed8ba091de8b5fc608]) successfully deleted
I20260619 02:44:25.338387 14864 tablet_service.cc:1467] Processing CreateTablet for tablet 0765015398ba4137863e2deec93f624a (DEFAULT_TABLE table=test-table [id=01f21134850f48d5ba6598bae4c77388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:25.338428 15161 ts_tablet_manager.cc:1918] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:44:25.338479 15161 log.cc:1196] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/9a6fc092a88f47f8b9910bb178185b44
I20260619 02:44:25.338486 14864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0765015398ba4137863e2deec93f624a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:25.338516 14725 tablet_service.cc:1467] Processing CreateTablet for tablet 0765015398ba4137863e2deec93f624a (DEFAULT_TABLE table=test-table [id=01f21134850f48d5ba6598bae4c77388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:25.338639 14725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0765015398ba4137863e2deec93f624a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:25.338727 15161 ts_tablet_manager.cc:1939] T 9a6fc092a88f47f8b9910bb178185b44 P 1f1101d1904e49779751e96d43f53a4d: Deleting consensus metadata
I20260619 02:44:25.339713 15175 tablet_bootstrap.cc:492] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203: Bootstrap starting.
I20260619 02:44:25.339855 14574 catalog_manager.cc:4841] TS 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871): tablet 9a6fc092a88f47f8b9910bb178185b44 (table test-table [id=e4072f5fd8a847ed8ba091de8b5fc608]) successfully deleted
I20260619 02:44:25.339939 15005 tablet_service.cc:1467] Processing CreateTablet for tablet 0765015398ba4137863e2deec93f624a (DEFAULT_TABLE table=test-table [id=01f21134850f48d5ba6598bae4c77388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:25.340021 15005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0765015398ba4137863e2deec93f624a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:25.340061 15175 tablet_bootstrap.cc:654] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:25.340371 15172 tablet_bootstrap.cc:492] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: Bootstrap starting.
I20260619 02:44:25.340643 15172 tablet_bootstrap.cc:654] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:25.340909 15171 tablet_bootstrap.cc:492] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: Bootstrap starting.
I20260619 02:44:25.340986 15175 tablet_bootstrap.cc:492] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203: No bootstrap required, opened a new log
I20260619 02:44:25.341037 15175 ts_tablet_manager.cc:1397] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260619 02:44:25.341189 15175 raft_consensus.cc:348] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.341280 15175 raft_consensus.cc:374] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:25.341285 15171 tablet_bootstrap.cc:654] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:25.341305 15175 raft_consensus.cc:729] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aefd7bd3cd4e809437cf5dbebf5203, State: Initialized, Role: FOLLOWER
I20260619 02:44:25.341355 15175 consensus_queue.cc:260] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.341464 15175 ts_tablet_manager.cc:1428] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:25.341771 15172 tablet_bootstrap.cc:492] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: No bootstrap required, opened a new log
I20260619 02:44:25.341822 15172 ts_tablet_manager.cc:1397] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260619 02:44:25.341894 15171 tablet_bootstrap.cc:492] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: No bootstrap required, opened a new log
I20260619 02:44:25.341938 15171 ts_tablet_manager.cc:1397] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:25.341917 15172 raft_consensus.cc:348] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.341980 15172 raft_consensus.cc:374] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:25.342000 15172 raft_consensus.cc:729] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2d03fdc8204f9288e3a7644eefb4d0, State: Initialized, Role: FOLLOWER
I20260619 02:44:25.342037 15172 consensus_queue.cc:260] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.342125 15172 ts_tablet_manager.cc:1428] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:25.342095 15171 raft_consensus.cc:348] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.342156 15171 raft_consensus.cc:374] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:25.342175 15171 raft_consensus.cc:729] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1101d1904e49779751e96d43f53a4d, State: Initialized, Role: FOLLOWER
I20260619 02:44:25.342209 15171 consensus_queue.cc:260] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.342303 15171 ts_tablet_manager.cc:1428] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:25.607426 15178 raft_consensus.cc:482] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:25.607522 15178 raft_consensus.cc:504] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.607897 15178 leader_election.cc:288] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:25.610930 15186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.608141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:49189 (local address 127.12.145.67:34871)
0619 02:44:25.608187 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.608190 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.608321 (+ 131us) server_negotiation.cc:407] Connection header received
0619 02:44:25.608391 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.608392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.608403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.608469 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:25.608615 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.609133 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.610181 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.610588 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.610676 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.610685 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.610824 (+ 139us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.610859 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:44:25.610934 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.608138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:44565 (local address 127.12.145.66:38385)
0619 02:44:25.608194 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.608196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.608236 (+ 40us) server_negotiation.cc:407] Connection header received
0619 02:44:25.608333 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.608334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.608345 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.608423 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:25.608574 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.609105 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.610192 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.610606 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.610682 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.610691 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.610831 (+ 140us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.610865 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:44:25.610952 15200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.608102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:34871 (local address 127.12.145.65:49189)
0619 02:44:25.608239 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.608249 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.608331 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.608473 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.608473 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.608475 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:25.608547 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.608549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.609232 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.609233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.610091 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.610093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.610674 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.610675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.610751 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.610755 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.610818 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.610861 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":33,"thread_start_us":92,"threads_started":1}
I20260619 02:44:25.610960 15199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.608030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:38385 (local address 127.12.145.65:44565)
0619 02:44:25.608177 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.608189 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.608254 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.608429 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.608430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.608432 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:25.608502 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.608504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.609234 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.609235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.610088 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.610090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.610693 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.610694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.610764 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.610767 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.610827 (+ 60us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.610867 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":32,"thread_start_us":73,"threads_started":1}
I20260619 02:44:25.611253 15024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0765015398ba4137863e2deec93f624a" candidate_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d" is_pre_election: true
I20260619 02:44:25.611347 15024 raft_consensus.cc:2454] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aefd7bd3cd4e809437cf5dbebf5203 in term 0.
I20260619 02:44:25.611485 14885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0765015398ba4137863e2deec93f624a" candidate_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" is_pre_election: true
I20260619 02:44:25.611552 14885 raft_consensus.cc:2454] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aefd7bd3cd4e809437cf5dbebf5203 in term 0.
I20260619 02:44:25.611673 14678 leader_election.cc:302] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f1101d1904e49779751e96d43f53a4d, 93aefd7bd3cd4e809437cf5dbebf5203; no voters:
I20260619 02:44:25.611817 15178 raft_consensus.cc:2781] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:25.611868 15178 raft_consensus.cc:482] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:25.611884 15178 raft_consensus.cc:3037] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:25.612524 15178 raft_consensus.cc:504] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.612653 15178 leader_election.cc:288] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [CANDIDATE]: Term 1 election: Requested vote from peers 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385), 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871)
I20260619 02:44:25.612810 14885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0765015398ba4137863e2deec93f624a" candidate_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0"
I20260619 02:44:25.612828 15024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0765015398ba4137863e2deec93f624a" candidate_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1101d1904e49779751e96d43f53a4d"
I20260619 02:44:25.612898 15024 raft_consensus.cc:3037] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:25.612900 14885 raft_consensus.cc:3037] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:25.613474 14885 raft_consensus.cc:2454] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aefd7bd3cd4e809437cf5dbebf5203 in term 1.
I20260619 02:44:25.613528 15024 raft_consensus.cc:2454] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aefd7bd3cd4e809437cf5dbebf5203 in term 1.
I20260619 02:44:25.613695 14677 leader_election.cc:302] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2d03fdc8204f9288e3a7644eefb4d0, 93aefd7bd3cd4e809437cf5dbebf5203; no voters:
I20260619 02:44:25.613803 15178 raft_consensus.cc:2781] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:25.613940 15178 raft_consensus.cc:686] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 LEADER]: Becoming Leader. State: Replica: 93aefd7bd3cd4e809437cf5dbebf5203, State: Running, Role: LEADER
I20260619 02:44:25.614018 15178 consensus_queue.cc:237] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } }
I20260619 02:44:25.614727 14587 catalog_manager.cc:5495] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65). New cstate: current_term: 1 leader_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aefd7bd3cd4e809437cf5dbebf5203" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 } health_report { overall_health: UNKNOWN } } }
I20260619 02:44:25.627543 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.625253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53980 (local address 127.12.145.65:33263)
0619 02:44:25.625302 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.625304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.625310 (+ 6us) server_negotiation.cc:407] Connection header received
0619 02:44:25.625339 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.625339 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.625360 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.625429 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:25.625550 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.625988 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.626761 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.626991 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.627068 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.627220 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.627321 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.627391 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.627441 (+ 50us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.627460 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260619 02:44:25.631642 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.629719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:34173 (local address 127.12.145.66:38385)
0619 02:44:25.629769 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.629770 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.629797 (+ 27us) server_negotiation.cc:407] Connection header received
0619 02:44:25.629832 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.629832 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.629840 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.629878 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:25.629967 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.630393 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.631117 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.631296 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.631341 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.631481 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.631503 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.631540 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.631583 (+ 43us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.631599 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260619 02:44:25.631671 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.629597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:38385 (local address 127.12.145.65:34173)
0619 02:44:25.629744 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.629753 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.629786 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.629879 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.629879 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.629880 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:25.629925 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.629925 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.630449 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.630449 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.631049 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.631051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.631366 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.631367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.631410 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.631421 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.631548 (+ 127us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.631550 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.631583 (+ 33us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.631612 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":68,"threads_started":1}
I20260619 02:44:25.633479 15024 raft_consensus.cc:1261] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Refusing update from remote peer 93aefd7bd3cd4e809437cf5dbebf5203: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:25.633656 14885 raft_consensus.cc:1261] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Refusing update from remote peer 93aefd7bd3cd4e809437cf5dbebf5203: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:25.633730 15178 consensus_queue.cc:1035] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1101d1904e49779751e96d43f53a4d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:25.633927 15201 consensus_queue.cc:1035] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2d03fdc8204f9288e3a7644eefb4d0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 38385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:25.640264 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.638163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:45295 (local address 127.12.145.65:33263)
0619 02:44:25.638210 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:25.638212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:25.638220 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:25.638238 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:25.638238 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:25.638247 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:25.638310 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:25.638441 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.639031 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.639651 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.639821 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.639866 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.640017 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.640039 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.640088 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:25.640160 (+ 72us) server_negotiation.cc:299] Negotiation successful
0619 02:44:25.640188 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260619 02:44:25.640304 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:25.638067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33263 (local address 127.12.145.66:45295)
0619 02:44:25.638107 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:25.638118 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:25.638156 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:25.638318 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:25.638319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:25.638320 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:44:25.638374 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.638375 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.639090 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.639091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.639589 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:25.639590 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:25.639877 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:25.639877 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:25.639928 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:25.639933 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:44:25.640104 (+ 171us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:44:25.640106 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:44:25.640155 (+ 49us) client_negotiation.cc:240] Negotiation successful
0619 02:44:25.640209 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
W20260619 02:44:25.640637 15144 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260619 02:44:27.159510 14586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:27.159611 14586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:27.160394 14586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 248c2b2c00a5462a84ba7ce8a2857166: Sending DeleteTablet for 3 replicas of tablet 0765015398ba4137863e2deec93f624a
I20260619 02:44:27.160601 14725 tablet_service.cc:1514] Processing DeleteTablet for tablet 0765015398ba4137863e2deec93f624a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:27 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:47532
I20260619 02:44:27.160636 14864 tablet_service.cc:1514] Processing DeleteTablet for tablet 0765015398ba4137863e2deec93f624a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:27 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:53770
I20260619 02:44:27.160631 15005 tablet_service.cc:1514] Processing DeleteTablet for tablet 0765015398ba4137863e2deec93f624a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:27 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:51838
I20260619 02:44:27.160789 15230 tablet_replica.cc:330] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203: stopping tablet replica
I20260619 02:44:27.160815 15231 tablet_replica.cc:330] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: stopping tablet replica
I20260619 02:44:27.160858 15230 raft_consensus.cc:2229] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:27.160894 15231 raft_consensus.cc:2229] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:27.160915 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 14660
I20260619 02:44:27.160949 15230 raft_consensus.cc:2258] T 0765015398ba4137863e2deec93f624a P 93aefd7bd3cd4e809437cf5dbebf5203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:27.160964 15231 raft_consensus.cc:2258] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:27.161835 15231 ts_tablet_manager.cc:1905] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:27.163863 15231 ts_tablet_manager.cc:1918] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 02:44:27.163915 15231 log.cc:1196] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/0765015398ba4137863e2deec93f624a
I20260619 02:44:27.164132 15231 ts_tablet_manager.cc:1939] T 0765015398ba4137863e2deec93f624a P 1f1101d1904e49779751e96d43f53a4d: Deleting consensus metadata
I20260619 02:44:27.164285 15232 tablet_replica.cc:330] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: stopping tablet replica
I20260619 02:44:27.164337 15232 raft_consensus.cc:2229] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:27.164374 15232 raft_consensus.cc:2258] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:27.164552 14574 catalog_manager.cc:4841] TS 1f1101d1904e49779751e96d43f53a4d (127.12.145.67:34871): tablet 0765015398ba4137863e2deec93f624a (table test-table [id=01f21134850f48d5ba6598bae4c77388]) successfully deleted
I20260619 02:44:27.164655 15232 ts_tablet_manager.cc:1905] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:27.166488 15232 ts_tablet_manager.cc:1918] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 02:44:27.166539 15232 log.cc:1196] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/0765015398ba4137863e2deec93f624a
I20260619 02:44:27.166774 15232 ts_tablet_manager.cc:1939] T 0765015398ba4137863e2deec93f624a P 4f2d03fdc8204f9288e3a7644eefb4d0: Deleting consensus metadata
I20260619 02:44:27.167176 14573 catalog_manager.cc:4841] TS 4f2d03fdc8204f9288e3a7644eefb4d0 (127.12.145.66:38385): tablet 0765015398ba4137863e2deec93f624a (table test-table [id=01f21134850f48d5ba6598bae4c77388]) successfully deleted
W20260619 02:44:27.168978 14572 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:33263 (error 108)
I20260619 02:44:27.169291 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 14800
I20260619 02:44:27.172282 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:27.169335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33263 (local address 127.0.0.1:53984)
0619 02:44:27.172167 (+ 2832us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:27.172232 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2807,"thread_start_us":57,"threads_started":1}
W20260619 02:44:27.172581 14572 catalog_manager.cc:4584] TS 93aefd7bd3cd4e809437cf5dbebf5203 (127.12.145.65:33263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0765015398ba4137863e2deec93f624a: Network error: Client connection negotiation failed: client connection to 127.12.145.65:33263: connect: Connection refused (error 111)
I20260619 02:44:27.176892 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 14940
I20260619 02:44:27.182521 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 14556
2026-06-19T02:44:27Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5885 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:27 dist-test-slave-fbl4 krb5kdc[15237](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:27 dist-test-slave-fbl4 krb5kdc[15237](info): set up 2 sockets
Jun 19 02:44:27 dist-test-slave-fbl4 krb5kdc[15237](info): commencing operation
krb5kdc: starting...
W20260619 02:44:28.214282 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:28.325418 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:46317
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:46317
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:28.402513 15250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:28.402745 15250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:28.402766 15250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:28.403924 15250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:28.403967 15250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:28.403982 15250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:28.403995 15250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:28.404043 15250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:28.405437 15250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:46317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:46317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:28.405671 15250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:28.405884 15250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:28.410778 15256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:28.410805 15258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:28.410789 15255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:28.410805 15250 server_base.cc:1034] running on GCE node
I20260619 02:44:28.411267 15250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:28.411550 15250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:28.412703 15250 hybrid_clock.cc:648] HybridClock initialized: now 1781837068412694 us; error 30 us; skew 500 ppm
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:28.415164 15250 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:28.415591 15250 webserver.cc:460] Webserver started at http://127.12.145.126:39049/ using document root <none> and password file <none>
I20260619 02:44:28.415820 15250 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:28.415885 15250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:28.416026 15250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:28.417061 15250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "b854e4e048d4486ab4d0e29eddab123b"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "e381319212600aff9c5e53bf05571613"
server_key_iv: "ec29c765d6ee3e7c41564165f4f46b78"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.417440 15250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "b854e4e048d4486ab4d0e29eddab123b"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "e381319212600aff9c5e53bf05571613"
server_key_iv: "ec29c765d6ee3e7c41564165f4f46b78"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.418769 15250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:44:28.419433 15265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.419590 15250 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:28.419693 15250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "b854e4e048d4486ab4d0e29eddab123b"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "e381319212600aff9c5e53bf05571613"
server_key_iv: "ec29c765d6ee3e7c41564165f4f46b78"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.419771 15250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:28.438802 15250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:28.441006 15250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:28.441164 15250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:28.444797 15250 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:46317
I20260619 02:44:28.444834 15317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:46317 every 8 connection(s)
I20260619 02:44:28.445173 15250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:28.446040 15318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:28.448319 15318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b: Bootstrap starting.
I20260619 02:44:28.448851 15318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:28.449128 15318 log.cc:824] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:28.449327 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 15250
I20260619 02:44:28.449419 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:28.449566 12869 external_mini_cluster.cc:1428] Setting key c9ab1bb8384a20d5b67479952f7d3c39
I20260619 02:44:28.449936 15318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b: No bootstrap required, opened a new log
I20260619 02:44:28.451745 15318 raft_consensus.cc:348] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b854e4e048d4486ab4d0e29eddab123b" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 46317 } }
I20260619 02:44:28.451871 15318 raft_consensus.cc:374] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:28.451894 15318 raft_consensus.cc:729] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b854e4e048d4486ab4d0e29eddab123b, State: Initialized, Role: FOLLOWER
I20260619 02:44:28.452042 15318 consensus_queue.cc:260] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b854e4e048d4486ab4d0e29eddab123b" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 46317 } }
I20260619 02:44:28.452140 15318 raft_consensus.cc:388] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:28.452170 15318 raft_consensus.cc:482] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:28.452226 15318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:28.452901 15318 raft_consensus.cc:504] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b854e4e048d4486ab4d0e29eddab123b" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 46317 } }
I20260619 02:44:28.453001 15318 leader_election.cc:302] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b854e4e048d4486ab4d0e29eddab123b; no voters:
I20260619 02:44:28.453173 15318 leader_election.cc:288] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:28.453222 15323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:28.453390 15323 raft_consensus.cc:686] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [term 1 LEADER]: Becoming Leader. State: Replica: b854e4e048d4486ab4d0e29eddab123b, State: Running, Role: LEADER
I20260619 02:44:28.453393 15318 sys_catalog.cc:564] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:28.453526 15323 consensus_queue.cc:237] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b854e4e048d4486ab4d0e29eddab123b" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 46317 } }
I20260619 02:44:28.453828 15325 sys_catalog.cc:455] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b854e4e048d4486ab4d0e29eddab123b. Latest consensus state: current_term: 1 leader_uuid: "b854e4e048d4486ab4d0e29eddab123b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b854e4e048d4486ab4d0e29eddab123b" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 46317 } } }
I20260619 02:44:28.453956 15325 sys_catalog.cc:458] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:28.454173 15332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:28.454720 15332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:28.457083 15324 sys_catalog.cc:455] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b854e4e048d4486ab4d0e29eddab123b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b854e4e048d4486ab4d0e29eddab123b" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 46317 } } }
I20260619 02:44:28.457175 15324 sys_catalog.cc:458] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b [sys.catalog]: This master's current role is: LEADER
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:28.458947 15332 catalog_manager.cc:1347] Generated new cluster ID: d3d00de0cbf1496e976edeee4d342dda
I20260619 02:44:28.458993 15332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:28.465157 15322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:28.450072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51132 (local address 127.12.145.126:46317)
0619 02:44:28.450238 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:28.450248 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:28.450280 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:44:28.451135 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:28.451145 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:28.451194 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:28.451339 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:28.451970 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.453630 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.454762 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.455328 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.455432 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:28.458053 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:28.458057 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:28.458057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:28.458066 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:28.463572 (+ 5506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.463970 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.463972 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.463973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.464069 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.464285 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.464285 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.464286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.464550 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:28.464687 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:28.464816 (+ 129us) server_negotiation.cc:299] Negotiation successful
0619 02:44:28.464939 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260619 02:44:28.468921 15332 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:28.469389 15332 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:28.473563 15332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b854e4e048d4486ab4d0e29eddab123b: Generated new TSK 0
I20260619 02:44:28.473718 15332 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:28.498066 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:46317
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:28.577001 15344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:28.577198 15344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:28.577219 15344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:28.578421 15344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:28.578462 15344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:28.578490 15344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:28.579942 15344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:46317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:28.580189 15344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:28.580415 15344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:28.585019 15349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:28.585026 15352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:28.585035 15350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:28.585292 15344 server_base.cc:1034] running on GCE node
I20260619 02:44:28.585500 15344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:28.585736 15344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:28.586865 15344 hybrid_clock.cc:648] HybridClock initialized: now 1781837068586858 us; error 27 us; skew 500 ppm
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:28.589113 15344 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:28.589461 15344 webserver.cc:460] Webserver started at http://127.12.145.65:38613/ using document root <none> and password file <none>
I20260619 02:44:28.589634 15344 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:28.589672 15344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:28.589756 15344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:28.590876 15344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "980e038cdd8841a9a0048381fcdae57a"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "c74780ac27ccab339f4566774c3b3491"
server_key_iv: "d53712d647ce2735d65ca5fbd434cac1"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.591171 15344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "980e038cdd8841a9a0048381fcdae57a"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "c74780ac27ccab339f4566774c3b3491"
server_key_iv: "d53712d647ce2735d65ca5fbd434cac1"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.592360 15344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:28.592996 15359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.593200 15344 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:28.593307 15344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "980e038cdd8841a9a0048381fcdae57a"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "c74780ac27ccab339f4566774c3b3491"
server_key_iv: "d53712d647ce2735d65ca5fbd434cac1"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.593390 15344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:28.607422 15344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:28.609261 15344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:28.609418 15344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:28.609630 15344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:28.609928 15344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:28.609977 15344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.610025 15344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:28.610049 15344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.615653 15344 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:42293
I20260619 02:44:28.615703 15472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:42293 every 8 connection(s)
I20260619 02:44:28.616034 15344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:28.622682 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 15344
I20260619 02:44:28.622751 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:28.622944 12869 external_mini_cluster.cc:1428] Setting key ed6daa860de68119b56f4c5d66111ebb
I20260619 02:44:28.625113 15322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:28.616669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:52437 (local address 127.12.145.126:46317)
0619 02:44:28.616747 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:28.616750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:28.616930 (+ 180us) server_negotiation.cc:407] Connection header received
0619 02:44:28.617378 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:28.617379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:28.617389 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:28.617442 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:28.618325 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.618882 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.619874 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.620054 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.620103 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:28.622096 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:28.622098 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:28.622098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:28.622104 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:28.623776 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.624137 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.624138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.624139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.624200 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.624444 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.624444 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.624445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.624583 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:28.624659 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:28.624878 (+ 219us) server_negotiation.cc:299] Negotiation successful
0619 02:44:28.624970 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 02:44:28.625272 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:28.616645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:46317 (local address 127.12.145.65:52437)
0619 02:44:28.616814 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:28.616848 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:28.617300 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:28.617536 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:28.617540 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:28.618065 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:28.618246 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:28.618251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.618986 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.618988 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:28.619797 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:28.619799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.620121 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.620122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:28.620220 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:28.620637 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:28.620646 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:28.622009 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:28.623858 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:28.623863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:28.623865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:28.624069 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:28.624264 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:28.624265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:28.624265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:28.624371 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:28.624652 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:28.624656 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:28.624760 (+ 104us) client_negotiation.cc:769] Sending connection context
0619 02:44:28.624838 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:44:28.624993 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260619 02:44:28.625738 15473 heartbeater.cc:347] Connected to a master server at 127.12.145.126:46317
I20260619 02:44:28.625839 15473 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:28.626001 15473 heartbeater.cc:511] Master 127.12.145.126:46317 requested a full tablet report, sending...
I20260619 02:44:28.626518 15282 ts_manager.cc:194] Registered new tserver with Master: 980e038cdd8841a9a0048381fcdae57a (127.12.145.65:42293)
I20260619 02:44:28.627151 15282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:52437
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:28.647389 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:46317
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:28.727334 15478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:28.727576 15478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:28.727617 15478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:28.728772 15478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:28.728832 15478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:28.728878 15478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:28.730269 15478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:46317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:28.730643 15478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:28.730866 15478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:28.735673 15486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:28.735774 15478 server_base.cc:1034] running on GCE node
W20260619 02:44:28.735625 15483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:28.735632 15484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:28.736090 15478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:28.736336 15478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:28.737494 15478 hybrid_clock.cc:648] HybridClock initialized: now 1781837068737484 us; error 27 us; skew 500 ppm
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:28.739838 15478 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:28.740288 15478 webserver.cc:460] Webserver started at http://127.12.145.66:44463/ using document root <none> and password file <none>
I20260619 02:44:28.740499 15478 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:28.740567 15478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:28.740706 15478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:28.741709 15478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "8f655b178cff4fb18950708f24e432cf"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "e6427034fd1633254ab0a9ed548128c2"
server_key_iv: "d0da4c1b25190f53b05efa992cd35664"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.742063 15478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "8f655b178cff4fb18950708f24e432cf"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "e6427034fd1633254ab0a9ed548128c2"
server_key_iv: "d0da4c1b25190f53b05efa992cd35664"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.743377 15478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:28.744062 15493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.744220 15478 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:28.744315 15478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "8f655b178cff4fb18950708f24e432cf"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "e6427034fd1633254ab0a9ed548128c2"
server_key_iv: "d0da4c1b25190f53b05efa992cd35664"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.744382 15478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:28.763278 15478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:28.764891 15478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:28.765039 15478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:28.765304 15478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:28.765601 15478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:28.765650 15478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.765692 15478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:28.765728 15478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.771396 15478 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:45017
I20260619 02:44:28.771445 15606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:45017 every 8 connection(s)
I20260619 02:44:28.771736 15478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:28.771972 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 15478
I20260619 02:44:28.772083 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:28.772289 12869 external_mini_cluster.cc:1428] Setting key cc685a1ed73c190f609a83c77eab02e8
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
I20260619 02:44:28.780810 15322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:28.772430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:55537 (local address 127.12.145.126:46317)
0619 02:44:28.772486 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:28.772489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:28.772744 (+ 255us) server_negotiation.cc:407] Connection header received
0619 02:44:28.773314 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:28.773315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:28.773328 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:28.773390 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:28.774301 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.774856 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.775817 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.776010 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.776091 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:28.778105 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:28.778106 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:28.778106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:28.778114 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:28.779471 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.779895 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.779897 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.779897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.779953 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.780202 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.780203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.780203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.780308 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:28.780378 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:28.780680 (+ 302us) server_negotiation.cc:299] Negotiation successful
0619 02:44:28.780746 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260619 02:44:28.780975 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:28.772413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:46317 (local address 127.12.145.66:55537)
0619 02:44:28.772586 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:28.772654 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:28.773219 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:28.773438 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:28.773441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:28.773985 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:28.774205 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:28.774210 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.774937 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.774938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:28.775731 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:28.775732 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.776098 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.776098 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:28.776234 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:28.776708 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:28.776721 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:28.778003 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:28.779582 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:28.779589 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:28.779591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:28.779810 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:28.780024 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:28.780025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:28.780025 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:28.780127 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:28.780369 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:28.780374 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:28.780532 (+ 158us) client_negotiation.cc:769] Sending connection context
0619 02:44:28.780657 (+ 125us) client_negotiation.cc:240] Negotiation successful
0619 02:44:28.780785 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260619 02:44:28.781381 15607 heartbeater.cc:347] Connected to a master server at 127.12.145.126:46317
I20260619 02:44:28.781471 15607 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:28.781641 15607 heartbeater.cc:511] Master 127.12.145.126:46317 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
I20260619 02:44:28.782022 15282 ts_manager.cc:194] Registered new tserver with Master: 8f655b178cff4fb18950708f24e432cf (127.12.145.66:45017)
I20260619 02:44:28.782487 15282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:55537
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:28.795292 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:46317
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:28.879053 15612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:28.879238 15612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:28.879259 15612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:28.880335 15612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:28.880367 15612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:28.880393 15612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:28.881700 15612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:46317
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:28.881862 15612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:28.882022 15612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:28.886615 15617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:28.886677 15618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:28.886616 15620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:28.886631 15612 server_base.cc:1034] running on GCE node
I20260619 02:44:28.886963 15612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:28.887192 15612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:28.888337 15612 hybrid_clock.cc:648] HybridClock initialized: now 1781837068888328 us; error 31 us; skew 500 ppm
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:28.890687 15612 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:28.891111 15612 webserver.cc:460] Webserver started at http://127.12.145.67:42571/ using document root <none> and password file <none>
I20260619 02:44:28.891322 15612 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:28.891386 15612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:28.891511 15612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:28.892462 15612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "5be3a8d044bc400b93efe83334b4870f"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "f7dfe2a44a342cf31be8cc4f58c0cf83"
server_key_iv: "e2bd5454f91fc46e0f4330dafa31225f"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.892808 15612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "5be3a8d044bc400b93efe83334b4870f"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "f7dfe2a44a342cf31be8cc4f58c0cf83"
server_key_iv: "e2bd5454f91fc46e0f4330dafa31225f"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.894244 15612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:28.895035 15627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.895213 15612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.895303 15612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "5be3a8d044bc400b93efe83334b4870f"
format_stamp: "Formatted at 2026-06-19 02:44:28 on dist-test-slave-fbl4"
server_key: "f7dfe2a44a342cf31be8cc4f58c0cf83"
server_key_iv: "e2bd5454f91fc46e0f4330dafa31225f"
server_key_version: "encryptionkey@0"
I20260619 02:44:28.895382 15612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:28.911710 15612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:28.913426 15612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:28.913591 15612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:28.913797 15612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:28.914077 15612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:28.914124 15612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.914156 15612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:28.914183 15612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:28.919780 15612 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:37089
I20260619 02:44:28.919816 15740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:37089 every 8 connection(s)
I20260619 02:44:28.920122 15612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:44:28 dist-test-slave-fbl4 krb5kdc[15237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:28.928326 15322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:28.920795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:46343 (local address 127.12.145.126:46317)
0619 02:44:28.920867 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:28.920869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:28.921028 (+ 159us) server_negotiation.cc:407] Connection header received
0619 02:44:28.921468 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:28.921469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:28.921478 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:28.921531 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:28.922473 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.923039 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.923964 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.924137 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.924182 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:28.926124 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:28.926125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:28.926125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:28.926130 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:28.927307 (+ 1177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.927632 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.927633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.927633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.927679 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:28.927865 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:28.927865 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:28.927866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:28.927955 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:28.928002 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:28.928209 (+ 207us) server_negotiation.cc:299] Negotiation successful
0619 02:44:28.928262 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:44:28.928474 15743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:28.920763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:46317 (local address 127.12.145.67:46343)
0619 02:44:28.920914 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:28.920948 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:28.921392 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:28.921590 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:28.921593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:28.922201 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:28.922403 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:28.922407 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.923112 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.923112 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:28.923896 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:28.923897 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:28.924194 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:28.924195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:28.924284 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:28.924785 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:28.924793 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:28.926058 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:28.927369 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:28.927374 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:28.927375 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:28.927574 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:28.927730 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:28.927730 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:28.927730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:28.927817 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:28.928002 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:28.928005 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:28.928103 (+ 98us) client_negotiation.cc:769] Sending connection context
0619 02:44:28.928181 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:44:28.928289 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260619 02:44:28.928875 15741 heartbeater.cc:347] Connected to a master server at 127.12.145.126:46317
I20260619 02:44:28.928957 15741 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:28.929086 15741 heartbeater.cc:511] Master 127.12.145.126:46317 requested a full tablet report, sending...
I20260619 02:44:28.929389 15282 ts_manager.cc:194] Registered new tserver with Master: 5be3a8d044bc400b93efe83334b4870f (127.12.145.67:37089)
I20260619 02:44:28.929713 15282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:46343
I20260619 02:44:28.929935 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 15612
I20260619 02:44:28.930038 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:28.930227 12869 external_mini_cluster.cc:1428] Setting key ddf5c88e601e06d931c2e66572eae5a9
I20260619 02:44:28.931066 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 02:44:28.941040 15322 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:28.940320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.12.145.126:46317)
0619 02:44:28.940357 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:28.940359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:28.940446 (+ 87us) server_negotiation.cc:407] Connection header received
0619 02:44:28.940497 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:28.940497 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:28.940505 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:28.940578 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:28.940996 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51148: BlockingRecv error: recv got EOF from 127.0.0.1:51148 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:44:28.941923 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 15344
I20260619 02:44:28.946998 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 15478
I20260619 02:44:28.951027 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 15612
I20260619 02:44:28.955233 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 15250
2026-06-19T02:44:28Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1771 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:29 dist-test-slave-fbl4 krb5kdc[15753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:29 dist-test-slave-fbl4 krb5kdc[15753](info): set up 2 sockets
Jun 19 02:44:29 dist-test-slave-fbl4 krb5kdc[15753](info): commencing operation
krb5kdc: starting...
W20260619 02:44:29.974524 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.000s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:30 dist-test-slave-fbl4 krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:30.084972 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45191
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:45771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:45191
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:30.164445 15766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:30.164651 15766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:30.164673 15766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:30.165725 15766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:30.165759 15766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:30.165773 15766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:30.165786 15766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:30.165796 15766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:30.167173 15766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:45771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:45191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:30.167346 15766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:30.167495 15766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:30.172022 15771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:30.172129 15766 server_base.cc:1034] running on GCE node
W20260619 02:44:30.172034 15774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:30.172053 15772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:30.172447 15766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:30.172724 15766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:30.173868 15766 hybrid_clock.cc:648] HybridClock initialized: now 1781837070173855 us; error 28 us; skew 500 ppm
Jun 19 02:44:30 dist-test-slave-fbl4 krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837070, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:30.176340 15766 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:30.176736 15766 webserver.cc:460] Webserver started at http://127.12.145.126:39357/ using document root <none> and password file <none>
I20260619 02:44:30.176941 15766 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:30.176983 15766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:30.177121 15766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:30.178097 15766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5"
format_stamp: "Formatted at 2026-06-19 02:44:30 on dist-test-slave-fbl4"
server_key: "105cbd557ab7db202e2ce5635d4d11a0"
server_key_iv: "14b2c4f2d0cbae3924332d47daf3ab11"
server_key_version: "encryptionkey@0"
I20260619 02:44:30.178431 15766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5"
format_stamp: "Formatted at 2026-06-19 02:44:30 on dist-test-slave-fbl4"
server_key: "105cbd557ab7db202e2ce5635d4d11a0"
server_key_iv: "14b2c4f2d0cbae3924332d47daf3ab11"
server_key_version: "encryptionkey@0"
I20260619 02:44:30.179697 15766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:44:30.180375 15781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:30.180549 15766 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:30.180645 15766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5"
format_stamp: "Formatted at 2026-06-19 02:44:30 on dist-test-slave-fbl4"
server_key: "105cbd557ab7db202e2ce5635d4d11a0"
server_key_iv: "14b2c4f2d0cbae3924332d47daf3ab11"
server_key_version: "encryptionkey@0"
I20260619 02:44:30.180711 15766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:30.192253 15766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:30.194355 15766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:30.194516 15766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:30.198230 15766 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:45191
I20260619 02:44:30.198272 15833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:45191 every 8 connection(s)
I20260619 02:44:30.198768 15766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:30.199363 15834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:30.200101 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 15766
I20260619 02:44:30.200179 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:30.200352 12869 external_mini_cluster.cc:1428] Setting key 3a76977f509df10a0406cf4977673b8a
I20260619 02:44:30.202042 15834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5: Bootstrap starting.
I20260619 02:44:30.202673 15834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:30.202930 15834 log.cc:824] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:30.203552 15834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5: No bootstrap required, opened a new log
I20260619 02:44:30.205245 15834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45191 } }
I20260619 02:44:30.205389 15834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:30.205442 15834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f0b0e9aeac4b4099a6e7eef9a059b5, State: Initialized, Role: FOLLOWER
I20260619 02:44:30.205590 15834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45191 } }
I20260619 02:44:30.205675 15834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:30.205717 15834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:30.205765 15834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:30.206410 15834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45191 } }
I20260619 02:44:30.206521 15834 leader_election.cc:302] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50f0b0e9aeac4b4099a6e7eef9a059b5; no voters:
Jun 19 02:44:30 dist-test-slave-fbl4 krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:30.206693 15834 leader_election.cc:288] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:30.206743 15839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:30.206888 15839 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [term 1 LEADER]: Becoming Leader. State: Replica: 50f0b0e9aeac4b4099a6e7eef9a059b5, State: Running, Role: LEADER
I20260619 02:44:30.206946 15834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:30.206982 15839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45191 } }
I20260619 02:44:30.207403 15840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45191 } } }
I20260619 02:44:30.207393 15841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50f0b0e9aeac4b4099a6e7eef9a059b5. Latest consensus state: current_term: 1 leader_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50f0b0e9aeac4b4099a6e7eef9a059b5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45191 } } }
I20260619 02:44:30.207783 15840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:30.207791 15841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:30.208019 15848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:30.208804 15848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:30.210253 15848 catalog_manager.cc:1347] Generated new cluster ID: fb23868521f24e06bda6d112e79b1d6e
I20260619 02:44:30.210305 15848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:30.210986 15837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:30.200822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33944 (local address 127.12.145.126:45191)
0619 02:44:30.200996 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:30.201006 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:30.201037 (+ 31us) server_negotiation.cc:407] Connection header received
0619 02:44:30.201421 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:30.201427 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:30.201469 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:30.201613 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:30.202237 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:30.203288 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:30.204088 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:30.204498 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:30.204609 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:30.207228 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:30.207232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:30.207232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:30.207243 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:30.209285 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:30.209663 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:30.209666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:30.209666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:30.209771 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:30.209999 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:30.210000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:30.210000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:30.210311 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:30.210453 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:30.210703 (+ 250us) server_negotiation.cc:299] Negotiation successful
0619 02:44:30.210839 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260619 02:44:30.211812 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:44:30.218593 15848 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:30.219262 15848 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:30.226445 15848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50f0b0e9aeac4b4099a6e7eef9a059b5: Generated new TSK 0
I20260619 02:44:30.226632 15848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:44:30.229333 15837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:30.225643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33946 (local address 127.12.145.126:45191)
0619 02:44:30.225682 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:30.225684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:30.225845 (+ 161us) server_negotiation.cc:407] Connection header received
0619 02:44:30.225932 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:30.225932 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:30.225944 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:30.225996 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:30.226421 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:30.227009 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:30.228062 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:30.228269 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:30.228318 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:30.228932 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:30.228933 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:30.228934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:30.229090 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:30.229104 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:30.229110 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:30.229153 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:30.229237 (+ 84us) server_negotiation.cc:299] Negotiation successful
0619 02:44:30.229256 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:44:30.231882 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 15766
2026-06-19T02:44:30Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1275 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:30 dist-test-slave-fbl4 krb5kdc[15867](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:30 dist-test-slave-fbl4 krb5kdc[15867](info): set up 2 sockets
Jun 19 02:44:30 dist-test-slave-fbl4 krb5kdc[15867](info): commencing operation
krb5kdc: starting...
W20260619 02:44:31.274667 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:31.387038 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:35973
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:35973
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:31.465941 15880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:31.466185 15880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:31.466223 15880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:31.467381 15880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:31.467449 15880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:31.467483 15880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:31.467558 15880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:31.467602 15880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:31.469031 15880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:35973
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:35973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:31.469312 15880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:31.469558 15880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:31.474321 15886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:31.474387 15880 server_base.cc:1034] running on GCE node
W20260619 02:44:31.474328 15888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:31.474341 15885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:31.474772 15880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:31.475080 15880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:31.476227 15880 hybrid_clock.cc:648] HybridClock initialized: now 1781837071476207 us; error 36 us; skew 500 ppm
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:31.478689 15880 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:31.479100 15880 webserver.cc:460] Webserver started at http://127.12.145.126:43987/ using document root <none> and password file <none>
I20260619 02:44:31.479328 15880 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:31.479373 15880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:31.479521 15880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:31.480577 15880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "1ce986305920d69fdb580ca470956790"
server_key_iv: "558a5b72822ad9d0c34863e3f9705012"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.480928 15880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "1ce986305920d69fdb580ca470956790"
server_key_iv: "558a5b72822ad9d0c34863e3f9705012"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.482225 15880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:31.483001 15895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.483170 15880 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.483268 15880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "1ce986305920d69fdb580ca470956790"
server_key_iv: "558a5b72822ad9d0c34863e3f9705012"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.483346 15880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:31.494832 15880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:31.496996 15880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:31.497150 15880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:31.500875 15880 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:35973
I20260619 02:44:31.500906 15947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:35973 every 8 connection(s)
I20260619 02:44:31.501256 15880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:31.502219 15948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:31.504441 15948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd: Bootstrap starting.
I20260619 02:44:31.505005 15948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:31.505285 15948 log.cc:824] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:31.505954 15948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd: No bootstrap required, opened a new log
I20260619 02:44:31.507536 15948 raft_consensus.cc:348] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35973 } }
I20260619 02:44:31.507668 15948 raft_consensus.cc:374] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:31.507740 15948 raft_consensus.cc:729] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af2a41a0a9fe4f84bd3d93d3fa7904bd, State: Initialized, Role: FOLLOWER
I20260619 02:44:31.507893 15948 consensus_queue.cc:260] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35973 } }
I20260619 02:44:31.507956 15948 raft_consensus.cc:388] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:31.507975 15948 raft_consensus.cc:482] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:31.508044 15948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:31.508827 15948 raft_consensus.cc:504] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35973 } }
I20260619 02:44:31.508939 15948 leader_election.cc:302] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af2a41a0a9fe4f84bd3d93d3fa7904bd; no voters:
I20260619 02:44:31.509121 15948 leader_election.cc:288] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:31.509140 15951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:31.509315 15951 raft_consensus.cc:686] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [term 1 LEADER]: Becoming Leader. State: Replica: af2a41a0a9fe4f84bd3d93d3fa7904bd, State: Running, Role: LEADER
I20260619 02:44:31.509374 15948 sys_catalog.cc:564] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:31.509511 15951 consensus_queue.cc:237] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35973 } }
I20260619 02:44:31.509883 15953 sys_catalog.cc:455] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader af2a41a0a9fe4f84bd3d93d3fa7904bd. Latest consensus state: current_term: 1 leader_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35973 } } }
I20260619 02:44:31.509982 15953 sys_catalog.cc:458] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:31.509878 15952 sys_catalog.cc:455] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af2a41a0a9fe4f84bd3d93d3fa7904bd" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35973 } } }
I20260619 02:44:31.510155 15952 sys_catalog.cc:458] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:31.510496 15959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:31.510941 15959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:31.511111 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 15880
I20260619 02:44:31.511224 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:31.511410 12869 external_mini_cluster.cc:1428] Setting key 36c3ac1a730afcb5f172268e5abf4dba
I20260619 02:44:31.512892 15959 catalog_manager.cc:1347] Generated new cluster ID: 81f44ff878874eb793f69d53fa19075d
I20260619 02:44:31.512943 15959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:31.521441 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:31.511833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59536 (local address 127.12.145.126:35973)
0619 02:44:31.512024 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:31.512033 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:31.512065 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:44:31.512201 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:31.512208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:31.512263 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:31.512410 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:31.513260 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.514164 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.515053 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.515493 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.515624 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:31.517930 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:31.517934 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:31.517934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:31.517946 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:31.519949 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:31.520320 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:31.520325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:31.520326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:31.520421 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:31.520631 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:31.520632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:31.520632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:31.520860 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:31.521033 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:31.521099 (+ 66us) server_negotiation.cc:299] Negotiation successful
0619 02:44:31.521239 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260619 02:44:31.524744 15959 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:31.525213 15959 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:31.535145 15959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af2a41a0a9fe4f84bd3d93d3fa7904bd: Generated new TSK 0
I20260619 02:44:31.535315 15959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:31.568987 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35973
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:31.670171 15974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:31.670356 15974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:31.670378 15974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:31.671501 15974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:31.671548 15974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:31.671578 15974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:31.672926 15974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:31.673094 15974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:31.673257 15974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:31.678032 15979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:31.678049 15980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:31.678221 15974 server_base.cc:1034] running on GCE node
W20260619 02:44:31.678049 15982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:31.678471 15974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:31.678764 15974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:31.679929 15974 hybrid_clock.cc:648] HybridClock initialized: now 1781837071679917 us; error 25 us; skew 500 ppm
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:31.682367 15974 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:31.682788 15974 webserver.cc:460] Webserver started at http://127.12.145.65:35919/ using document root <none> and password file <none>
I20260619 02:44:31.682976 15974 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:31.683014 15974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:31.683099 15974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:31.684032 15974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "908cd967f63241baabbd136841606956"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "5128b4bdc111279b76dbcdbb109d0136"
server_key_iv: "e69b82388b481aac225ead0541cc3012"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.684327 15974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "908cd967f63241baabbd136841606956"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "5128b4bdc111279b76dbcdbb109d0136"
server_key_iv: "e69b82388b481aac225ead0541cc3012"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.685495 15974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:31.686215 15989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.686362 15974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:31.686448 15974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "908cd967f63241baabbd136841606956"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "5128b4bdc111279b76dbcdbb109d0136"
server_key_iv: "e69b82388b481aac225ead0541cc3012"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.686499 15974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:31.696233 15974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:31.697835 15974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:31.697937 15974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:31.698096 15974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:31.698324 15974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:31.698354 15974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.698372 15974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:31.698385 15974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.703778 15974 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:39233
I20260619 02:44:31.703858 16102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:39233 every 8 connection(s)
I20260619 02:44:31.704144 15974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:31.704424 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 15974
I20260619 02:44:31.704540 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:31.704752 12869 external_mini_cluster.cc:1428] Setting key 7b029e97eb3b0db15cf1e7913ab72b1c
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
I20260619 02:44:31.713745 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:31.704925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:39407 (local address 127.12.145.126:35973)
0619 02:44:31.704983 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:31.704986 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:31.705188 (+ 202us) server_negotiation.cc:407] Connection header received
0619 02:44:31.705748 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:31.705749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:31.705761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:31.705831 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:31.706809 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.707308 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.708369 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.708582 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.708669 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:31.710949 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:31.710950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:31.710951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:31.710959 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:31.712554 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:31.712922 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:31.712922 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:31.712923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:31.712973 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:31.713140 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:31.713140 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:31.713140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:31.713245 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:31.713294 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:31.713617 (+ 323us) server_negotiation.cc:299] Negotiation successful
0619 02:44:31.713683 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:44:31.713939 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:31.704894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35973 (local address 127.12.145.65:39407)
0619 02:44:31.705063 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:31.705104 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:31.705650 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:31.705878 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:31.705881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:31.706448 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:31.706715 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:31.706719 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.707403 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.707404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:31.708274 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:31.708276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.708678 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.708679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:31.708813 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:31.709316 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:31.709333 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:31.710865 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:31.712630 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:31.712635 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:31.712636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:31.712835 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:31.713017 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:31.713018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:31.713018 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:31.713092 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:31.713298 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:31.713302 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:31.713461 (+ 159us) client_negotiation.cc:769] Sending connection context
0619 02:44:31.713596 (+ 135us) client_negotiation.cc:240] Negotiation successful
0619 02:44:31.713710 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":75,"threads_started":1}
I20260619 02:44:31.714488 16103 heartbeater.cc:347] Connected to a master server at 127.12.145.126:35973
I20260619 02:44:31.714646 16103 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:31.714820 16103 heartbeater.cc:511] Master 127.12.145.126:35973 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
I20260619 02:44:31.715394 15912 ts_manager.cc:194] Registered new tserver with Master: 908cd967f63241baabbd136841606956 (127.12.145.65:39233)
I20260619 02:44:31.715988 15912 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:39407
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:31.728832 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35973
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:31.806871 16108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:31.807055 16108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:31.807076 16108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:31.808106 16108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:31.808140 16108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:31.808166 16108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:31.809633 16108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:31.809809 16108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:31.810017 16108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 02:44:31.814685 16108 server_base.cc:1034] running on GCE node
W20260619 02:44:31.814632 16114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:31.814633 16113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:31.814648 16116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:31.815032 16108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:31.815266 16108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:31.816429 16108 hybrid_clock.cc:648] HybridClock initialized: now 1781837071816416 us; error 42 us; skew 500 ppm
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:31.818852 16108 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:31.819250 16108 webserver.cc:460] Webserver started at http://127.12.145.66:32779/ using document root <none> and password file <none>
I20260619 02:44:31.819469 16108 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:31.819516 16108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:31.819676 16108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:31.820670 16108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "fda391dcee744574957f68a989f2cb8e"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "811bdb3033b979ab9f3f06c330f0e13d"
server_key_iv: "a93acecd59b931dcbf8ad028dbc17d91"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.821007 16108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "fda391dcee744574957f68a989f2cb8e"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "811bdb3033b979ab9f3f06c330f0e13d"
server_key_iv: "a93acecd59b931dcbf8ad028dbc17d91"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.822253 16108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:44:31.823123 16123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.823277 16108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:44:31.823377 16108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "fda391dcee744574957f68a989f2cb8e"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "811bdb3033b979ab9f3f06c330f0e13d"
server_key_iv: "a93acecd59b931dcbf8ad028dbc17d91"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.823447 16108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:31.842459 16108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:31.844796 16108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:31.844987 16108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:31.845206 16108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:31.845494 16108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:31.845544 16108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.845583 16108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:31.845613 16108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.851341 16108 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34837
I20260619 02:44:31.851387 16236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34837 every 8 connection(s)
I20260619 02:44:31.851678 16108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:31.853366 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 16108
I20260619 02:44:31.853503 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:31.853725 12869 external_mini_cluster.cc:1428] Setting key ab31f11a19935381b5152ce91adacb17
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:31.861423 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:31.852301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:37469 (local address 127.12.145.126:35973)
0619 02:44:31.852359 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:31.852362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:31.852571 (+ 209us) server_negotiation.cc:407] Connection header received
0619 02:44:31.853033 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:31.853034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:31.853042 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:31.853102 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:31.854265 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.854891 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.856154 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.856342 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.856398 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:31.858787 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:31.858789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:31.858789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:31.858796 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:31.860102 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:31.860495 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:31.860496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:31.860497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:31.860557 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:31.860801 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:31.860802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:31.860803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:31.860915 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:31.860990 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:31.861256 (+ 266us) server_negotiation.cc:299] Negotiation successful
0619 02:44:31.861334 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260619 02:44:31.861613 16239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:31.852287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35973 (local address 127.12.145.66:37469)
0619 02:44:31.852446 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:31.852485 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:31.852947 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:31.853153 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:31.853157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:31.853954 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:31.854163 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:31.854167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.854998 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.854999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:31.856066 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:31.856069 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.856425 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.856427 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:31.856564 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:31.857028 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:31.857038 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:31.858686 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:31.860202 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:31.860208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:31.860210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:31.860419 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:31.860623 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:31.860624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:31.860624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:31.860733 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:31.860981 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:31.860988 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:31.861119 (+ 131us) client_negotiation.cc:769] Sending connection context
0619 02:44:31.861234 (+ 115us) client_negotiation.cc:240] Negotiation successful
0619 02:44:31.861381 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
I20260619 02:44:31.862095 16237 heartbeater.cc:347] Connected to a master server at 127.12.145.126:35973
I20260619 02:44:31.862197 16237 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:31.862360 16237 heartbeater.cc:511] Master 127.12.145.126:35973 requested a full tablet report, sending...
I20260619 02:44:31.862771 15912 ts_manager.cc:194] Registered new tserver with Master: fda391dcee744574957f68a989f2cb8e (127.12.145.66:34837)
I20260619 02:44:31.863163 15912 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:37469
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:31.878219 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35973
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:31.956979 16242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:31.957206 16242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:31.957242 16242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:31.958346 16242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:31.958410 16242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:31.958454 16242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:31.959869 16242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:31.960119 16242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:31.960331 16242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:31.965091 16250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:31.965097 16248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:31.965267 16242 server_base.cc:1034] running on GCE node
W20260619 02:44:31.965128 16247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:31.965579 16242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:31.965842 16242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:31.966974 16242 hybrid_clock.cc:648] HybridClock initialized: now 1781837071966964 us; error 31 us; skew 500 ppm
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:31.969409 16242 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:31.969858 16242 webserver.cc:460] Webserver started at http://127.12.145.67:39207/ using document root <none> and password file <none>
I20260619 02:44:31.970070 16242 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:31.970115 16242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:31.970281 16242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:31.971355 16242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "71da9629def941a3bdc00a483d80ad5f"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "5fe7a8d3c3f8ae23034b47dfe8d5abfb"
server_key_iv: "cda0b217b888e059756191cd5f99ad1e"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.971707 16242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "71da9629def941a3bdc00a483d80ad5f"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "5fe7a8d3c3f8ae23034b47dfe8d5abfb"
server_key_iv: "cda0b217b888e059756191cd5f99ad1e"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.972957 16242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:44:31.973642 16257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.973830 16242 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:31.973901 16242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "71da9629def941a3bdc00a483d80ad5f"
format_stamp: "Formatted at 2026-06-19 02:44:31 on dist-test-slave-fbl4"
server_key: "5fe7a8d3c3f8ae23034b47dfe8d5abfb"
server_key_iv: "cda0b217b888e059756191cd5f99ad1e"
server_key_version: "encryptionkey@0"
I20260619 02:44:31.973982 16242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:31.987833 16242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:31.990070 16242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:31.990226 16242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:31.990473 16242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:31.990789 16242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:31.990823 16242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.990842 16242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:31.990886 16242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:31.996595 16242 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:33099
I20260619 02:44:31.996636 16370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:33099 every 8 connection(s)
I20260619 02:44:31.996929 16242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:44:32.002575 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 16242
I20260619 02:44:32.002681 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
Jun 19 02:44:31 dist-test-slave-fbl4 krb5kdc[15867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837071, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:32.002887 12869 external_mini_cluster.cc:1428] Setting key 75cd82f9e9d2840929616df5c2ff81d1
I20260619 02:44:32.005594 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:31.997581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:34357 (local address 127.12.145.126:35973)
0619 02:44:31.997622 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:31.997624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:31.997830 (+ 206us) server_negotiation.cc:407] Connection header received
0619 02:44:31.998340 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:31.998341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:31.998353 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:31.998418 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:31.999390 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.999883 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:32.000860 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:32.001059 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:32.001144 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:32.003215 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:32.003216 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:32.003217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:32.003223 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:32.004544 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:32.004891 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:32.004892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:32.004892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:32.004940 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:32.005134 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:32.005134 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:32.005135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:32.005231 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:32.005281 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:32.005481 (+ 200us) server_negotiation.cc:299] Negotiation successful
0619 02:44:32.005535 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:44:32.005868 16373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:31.997542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35973 (local address 127.12.145.67:34357)
0619 02:44:31.997711 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:31.997749 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:31.998239 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:31.998486 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:31.998490 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:31.999104 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:31.999285 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:31.999290 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:31.999972 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:31.999973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:32.000769 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:32.000771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:32.001152 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:32.001153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:32.001284 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:32.001698 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:32.001705 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:32.003149 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:32.004618 (+ 1469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:32.004623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:32.004625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:32.004827 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:32.004994 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:32.004994 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:32.004995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:32.005082 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:32.005283 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:32.005286 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:32.005391 (+ 105us) client_negotiation.cc:769] Sending connection context
0619 02:44:32.005469 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:44:32.005579 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260619 02:44:32.006340 16371 heartbeater.cc:347] Connected to a master server at 127.12.145.126:35973
I20260619 02:44:32.006445 16371 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:32.006639 16371 heartbeater.cc:511] Master 127.12.145.126:35973 requested a full tablet report, sending...
I20260619 02:44:32.007006 15912 ts_manager.cc:194] Registered new tserver with Master: 71da9629def941a3bdc00a483d80ad5f (127.12.145.67:33099)
I20260619 02:44:32.007337 15912 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:34357
I20260619 02:44:32.014654 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 02:44:32 dist-test-slave-fbl4 krb5kdc[15867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837072, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Jun 19 02:44:32 dist-test-slave-fbl4 krb5kdc[15867](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837072, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:32.036191 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:32.029508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59546 (local address 127.12.145.126:35973)
0619 02:44:32.029590 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:32.029592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:32.029607 (+ 15us) server_negotiation.cc:407] Connection header received
0619 02:44:32.029677 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:32.029678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:32.029687 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:32.029737 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:32.030237 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:32.030785 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:32.031477 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:32.031659 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:32.031713 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:32.033794 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:32.033796 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:32.033796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:32.033803 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:32.035151 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:32.035478 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:32.035479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:32.035479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:32.035557 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:32.035726 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:32.035727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:32.035727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:32.035866 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:32.035940 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:32.036020 (+ 80us) server_negotiation.cc:299] Negotiation successful
0619 02:44:32.036074 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260619 02:44:32.036450 15912 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59546
I20260619 02:44:32.036855 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 15974
I20260619 02:44:32.041234 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 16108
I20260619 02:44:32.045104 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 16242
I20260619 02:44:32.049131 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 15880
2026-06-19T02:44:32Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1818 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:32 dist-test-slave-fbl4 krb5kdc[16383](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:32 dist-test-slave-fbl4 krb5kdc[16383](info): set up 2 sockets
Jun 19 02:44:32 dist-test-slave-fbl4 krb5kdc[16383](info): commencing operation
krb5kdc: starting...
W20260619 02:44:33.086505 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:33.197193 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39743
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:39743
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:33.275276 16396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:33.275522 16396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:33.275560 16396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:33.276706 16396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:33.276774 16396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:33.276798 16396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:33.276818 16396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:33.276849 16396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:33.278321 16396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:39743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:33.278620 16396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:33.278856 16396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:33.283481 16401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:33.283504 16404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:33.283489 16402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:33.283730 16396 server_base.cc:1034] running on GCE node
I20260619 02:44:33.283987 16396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:33.284292 16396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:33.285431 16396 hybrid_clock.cc:648] HybridClock initialized: now 1781837073285419 us; error 29 us; skew 500 ppm
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:33.291617 16396 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:33.292083 16396 webserver.cc:460] Webserver started at http://127.12.145.126:46053/ using document root <none> and password file <none>
I20260619 02:44:33.292311 16396 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:33.292379 16396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:33.292526 16396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:33.293542 16396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "ffafbb40f50a4e79ac13c989ec824c46"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "2293079461791eace841b8d0b17fba5b"
server_key_iv: "a166e85ce4e7abca08b5f2221c37e788"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.293907 16396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "ffafbb40f50a4e79ac13c989ec824c46"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "2293079461791eace841b8d0b17fba5b"
server_key_iv: "a166e85ce4e7abca08b5f2221c37e788"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.295290 16396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:33.295981 16411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.296142 16396 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:33.296247 16396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "ffafbb40f50a4e79ac13c989ec824c46"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "2293079461791eace841b8d0b17fba5b"
server_key_iv: "a166e85ce4e7abca08b5f2221c37e788"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.296316 16396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:33.314837 16396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:33.316493 16396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:33.316649 16396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:33.320521 16396 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:39743
I20260619 02:44:33.320551 16463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:39743 every 8 connection(s)
I20260619 02:44:33.321053 16396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:33.321485 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 16396
I20260619 02:44:33.321610 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:33.321823 12869 external_mini_cluster.cc:1428] Setting key 08b92dbe4b533486c26b92fa9b559071
I20260619 02:44:33.321846 16464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:33.325016 16464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46: Bootstrap starting.
I20260619 02:44:33.325726 16464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:33.326004 16464 log.cc:824] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:33.326730 16464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46: No bootstrap required, opened a new log
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:33.328950 16464 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffafbb40f50a4e79ac13c989ec824c46" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39743 } }
I20260619 02:44:33.329102 16464 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:33.329126 16464 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffafbb40f50a4e79ac13c989ec824c46, State: Initialized, Role: FOLLOWER
I20260619 02:44:33.329268 16464 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffafbb40f50a4e79ac13c989ec824c46" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39743 } }
I20260619 02:44:33.329352 16464 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:33.329388 16464 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:33.329440 16464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:33.330003 16464 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffafbb40f50a4e79ac13c989ec824c46" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39743 } }
I20260619 02:44:33.330135 16464 leader_election.cc:302] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffafbb40f50a4e79ac13c989ec824c46; no voters:
I20260619 02:44:33.330291 16464 leader_election.cc:288] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:33.330325 16469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:33.330454 16469 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [term 1 LEADER]: Becoming Leader. State: Replica: ffafbb40f50a4e79ac13c989ec824c46, State: Running, Role: LEADER
I20260619 02:44:33.330545 16464 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:33.330564 16469 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffafbb40f50a4e79ac13c989ec824c46" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39743 } }
I20260619 02:44:33.330912 16469 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffafbb40f50a4e79ac13c989ec824c46. Latest consensus state: current_term: 1 leader_uuid: "ffafbb40f50a4e79ac13c989ec824c46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffafbb40f50a4e79ac13c989ec824c46" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39743 } } }
I20260619 02:44:33.330991 16469 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:33.331629 16470 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffafbb40f50a4e79ac13c989ec824c46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffafbb40f50a4e79ac13c989ec824c46" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39743 } } }
I20260619 02:44:33.331717 16470 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:33.332176 16475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:33.332728 16475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:33.333122 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.322303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60126 (local address 127.12.145.126:39743)
0619 02:44:33.322477 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:33.322484 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:33.322507 (+ 23us) server_negotiation.cc:407] Connection header received
0619 02:44:33.322973 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:33.322979 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:33.323023 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:33.323126 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:33.323906 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.324758 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.325822 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.326291 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.326407 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.329001 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:33.329004 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:33.329004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:33.329014 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:33.331043 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.331475 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.331477 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.331478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.331587 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.331839 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.331840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.331841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.332165 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:33.332721 (+ 556us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:33.332799 (+ 78us) server_negotiation.cc:299] Negotiation successful
0619 02:44:33.332930 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260619 02:44:33.334084 16475 catalog_manager.cc:1347] Generated new cluster ID: 061b24195b574a86b5746a91b15d95d4
I20260619 02:44:33.334141 16475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:33.338011 16475 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:33.338698 16475 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:33.343009 16475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffafbb40f50a4e79ac13c989ec824c46: Generated new TSK 0
I20260619 02:44:33.343169 16475 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:33.369251 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39743
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:33.448791 16490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:33.449005 16490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:33.449043 16490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:33.450161 16490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:33.450233 16490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:33.450279 16490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:33.451843 16490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:33.452106 16490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:33.452330 16490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:33.458139 16498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:33.458221 16496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:33.458139 16495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:33.458314 16490 server_base.cc:1034] running on GCE node
I20260619 02:44:33.458604 16490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:33.458873 16490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:33.460040 16490 hybrid_clock.cc:648] HybridClock initialized: now 1781837073460028 us; error 44 us; skew 500 ppm
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:33.462376 16490 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:33.462829 16490 webserver.cc:460] Webserver started at http://127.12.145.65:39731/ using document root <none> and password file <none>
I20260619 02:44:33.463065 16490 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:33.463133 16490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:33.463285 16490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:33.464284 16490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "988a7cb7236b4e4ab395a14f78629051"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "aca1fc2ca85796178cbffecdb53df014"
server_key_iv: "947d55ee20116b3a2c1247b55a9bc845"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.464658 16490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "988a7cb7236b4e4ab395a14f78629051"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "aca1fc2ca85796178cbffecdb53df014"
server_key_iv: "947d55ee20116b3a2c1247b55a9bc845"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.466030 16490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:33.466787 16505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.466964 16490 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:33.467056 16490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "988a7cb7236b4e4ab395a14f78629051"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "aca1fc2ca85796178cbffecdb53df014"
server_key_iv: "947d55ee20116b3a2c1247b55a9bc845"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.467134 16490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:33.481144 16490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:33.482861 16490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:33.483007 16490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:33.483228 16490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:33.483508 16490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:33.483560 16490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.483598 16490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:33.483625 16490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.489148 16490 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:38983
I20260619 02:44:33.489229 16618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:38983 every 8 connection(s)
I20260619 02:44:33.489516 16490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:33.493944 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 16490
I20260619 02:44:33.494021 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:33.494220 12869 external_mini_cluster.cc:1428] Setting key 868bd606827dbc3da695d4e79f17da3e
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:33.498868 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.490141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:33791 (local address 127.12.145.126:39743)
0619 02:44:33.490222 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:33.490224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:33.490398 (+ 174us) server_negotiation.cc:407] Connection header received
0619 02:44:33.491388 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:33.491389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:33.491401 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:33.491469 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:33.492045 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.492563 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.493519 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.493749 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.493825 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.495947 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:33.495948 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:33.495949 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:33.495958 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:33.497435 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.497852 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.497853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.497854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.497918 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.498176 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.498177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.498178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.498299 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:33.498376 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:33.498668 (+ 292us) server_negotiation.cc:299] Negotiation successful
0619 02:44:33.498779 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 02:44:33.499045 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.490121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39743 (local address 127.12.145.65:33791)
0619 02:44:33.490285 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:33.490317 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:33.491281 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:33.491535 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:33.491538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:33.491776 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:33.491943 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:33.491947 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.492648 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.492649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:33.493430 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:33.493432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.493840 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.493841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:33.493962 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.494443 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:33.494486 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:33.495828 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:33.497534 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:33.497541 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:33.497543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:33.497762 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:33.497995 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:33.497996 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:33.497997 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:33.498109 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:33.498378 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:33.498384 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:33.498511 (+ 127us) client_negotiation.cc:769] Sending connection context
0619 02:44:33.498644 (+ 133us) client_negotiation.cc:240] Negotiation successful
0619 02:44:33.498799 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":111,"threads_started":1}
I20260619 02:44:33.499541 16619 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39743
I20260619 02:44:33.499641 16619 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:33.499840 16619 heartbeater.cc:511] Master 127.12.145.126:39743 requested a full tablet report, sending...
I20260619 02:44:33.500319 16428 ts_manager.cc:194] Registered new tserver with Master: 988a7cb7236b4e4ab395a14f78629051 (127.12.145.65:38983)
I20260619 02:44:33.500914 16428 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:33791
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:33.517405 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39743
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:33.596700 16624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:33.596905 16624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:33.596927 16624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:33.597968 16624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:33.597999 16624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:33.598024 16624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:33.599445 16624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:33.599617 16624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:33.599769 16624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:33.604429 16630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:33.604404 16629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:33.604436 16624 server_base.cc:1034] running on GCE node
W20260619 02:44:33.604420 16632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:33.604797 16624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:33.605033 16624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:33.606190 16624 hybrid_clock.cc:648] HybridClock initialized: now 1781837073606189 us; error 40 us; skew 500 ppm
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:33.608500 16624 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:33.608896 16624 webserver.cc:460] Webserver started at http://127.12.145.66:33157/ using document root <none> and password file <none>
I20260619 02:44:33.609099 16624 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:33.609161 16624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:33.609304 16624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:33.610255 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "5196d2bc72b041e4b4667536d644ed8e"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "cdc02c2df52d3c4881cb82f7290360db"
server_key_iv: "b0586848a5db6613bf289a3e27b21a22"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.610641 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "5196d2bc72b041e4b4667536d644ed8e"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "cdc02c2df52d3c4881cb82f7290360db"
server_key_iv: "b0586848a5db6613bf289a3e27b21a22"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.611929 16624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:44:33.612588 16639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.612756 16624 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:33.612844 16624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "5196d2bc72b041e4b4667536d644ed8e"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "cdc02c2df52d3c4881cb82f7290360db"
server_key_iv: "b0586848a5db6613bf289a3e27b21a22"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.612916 16624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:33.637677 16624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:33.639501 16624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:33.639655 16624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:33.639887 16624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:33.640183 16624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:33.640236 16624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.640275 16624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:33.640300 16624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.645787 16624 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:45299
I20260619 02:44:33.645836 16752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:45299 every 8 connection(s)
I20260619 02:44:33.646127 16624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:33.651739 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 16624
I20260619 02:44:33.651957 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:33.652149 12869 external_mini_cluster.cc:1428] Setting key e7ea0607df071662abe1a8dd03294af1
I20260619 02:44:33.655058 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.646797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:56827 (local address 127.12.145.126:39743)
0619 02:44:33.646864 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:33.646866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:33.647055 (+ 189us) server_negotiation.cc:407] Connection header received
0619 02:44:33.647964 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:33.647965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:33.647974 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:33.648032 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:33.648612 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.649085 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.650032 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.650217 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.650268 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.652266 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:33.652268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:33.652268 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:33.652275 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:33.653675 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.654084 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.654086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.654086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.654150 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.654392 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.654393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.654393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.654511 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:33.654608 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:33.654889 (+ 281us) server_negotiation.cc:299] Negotiation successful
0619 02:44:33.654967 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260619 02:44:33.655251 16755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.646782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39743 (local address 127.12.145.66:56827)
0619 02:44:33.646947 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:33.646986 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:33.647875 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:33.648101 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:33.648104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:33.648351 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:33.648533 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:33.648536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.649167 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.649168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:33.649954 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:33.649956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.650283 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.650284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:33.650376 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.650804 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:33.650812 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:33.652163 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:33.653776 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:33.653782 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:33.653784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:33.654000 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:33.654214 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:33.654215 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:33.654216 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:33.654325 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:33.654628 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:33.654633 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:33.654761 (+ 128us) client_negotiation.cc:769] Sending connection context
0619 02:44:33.654869 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 02:44:33.655019 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":97,"threads_started":1}
I20260619 02:44:33.655735 16753 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39743
I20260619 02:44:33.655827 16753 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:33.655990 16753 heartbeater.cc:511] Master 127.12.145.126:39743 requested a full tablet report, sending...
I20260619 02:44:33.656375 16428 ts_manager.cc:194] Registered new tserver with Master: 5196d2bc72b041e4b4667536d644ed8e (127.12.145.66:45299)
I20260619 02:44:33.656873 16428 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:56827
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:33.675347 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39743
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:33.753371 16758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:33.753549 16758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:33.753571 16758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:33.754637 16758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:33.754689 16758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:33.754715 16758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:33.756104 16758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:33.756271 16758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:33.756433 16758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:33.760977 16766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:33.760993 16764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:33.760989 16763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:33.761251 16758 server_base.cc:1034] running on GCE node
I20260619 02:44:33.761431 16758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:33.761610 16758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:33.762766 16758 hybrid_clock.cc:648] HybridClock initialized: now 1781837073762756 us; error 37 us; skew 500 ppm
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:33.765192 16758 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:33.765600 16758 webserver.cc:460] Webserver started at http://127.12.145.67:43171/ using document root <none> and password file <none>
I20260619 02:44:33.765826 16758 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:33.765870 16758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:33.766026 16758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:33.767052 16758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "d68ee60f4143490885bdb3503d55a03a"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "6adaaa0606e35fc84123693eeb9bc89b"
server_key_iv: "9be86356dc98e7a2f06a106643503f99"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.767388 16758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "d68ee60f4143490885bdb3503d55a03a"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "6adaaa0606e35fc84123693eeb9bc89b"
server_key_iv: "9be86356dc98e7a2f06a106643503f99"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.768610 16758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:33.769249 16773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.769389 16758 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:33.769464 16758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "d68ee60f4143490885bdb3503d55a03a"
format_stamp: "Formatted at 2026-06-19 02:44:33 on dist-test-slave-fbl4"
server_key: "6adaaa0606e35fc84123693eeb9bc89b"
server_key_iv: "9be86356dc98e7a2f06a106643503f99"
server_key_version: "encryptionkey@0"
I20260619 02:44:33.769510 16758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:33.784799 16758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:33.786643 16758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:33.786746 16758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:33.786906 16758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:33.787127 16758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:33.787154 16758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.787182 16758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:33.787199 16758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:33.792359 16758 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:42099
I20260619 02:44:33.792462 16886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:42099 every 8 connection(s)
I20260619 02:44:33.792677 16758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:33.799306 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 16758
I20260619 02:44:33.799418 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:33.799626 12869 external_mini_cluster.cc:1428] Setting key 40f0802c2cc975e26b094314c1b1e2b1
I20260619 02:44:33.801424 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.793360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:40347 (local address 127.12.145.126:39743)
0619 02:44:33.793444 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:33.793446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:33.793621 (+ 175us) server_negotiation.cc:407] Connection header received
0619 02:44:33.794440 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:33.794441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:33.794459 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:33.794506 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:33.795103 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.795589 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.796491 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.796784 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.796839 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.798816 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:33.798818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:33.798818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:33.798825 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:33.800366 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.800712 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.800713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.800713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.800762 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.800924 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.800925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.800925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.801015 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:33.801061 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:33.801312 (+ 251us) server_negotiation.cc:299] Negotiation successful
0619 02:44:33.801365 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:44:33.801569 16889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.793306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39743 (local address 127.12.145.67:40347)
0619 02:44:33.793485 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:33.793534 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:33.794358 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:33.794611 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:33.794615 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:33.794860 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:33.795027 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:33.795031 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.795672 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.795673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:33.796422 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:33.796424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.796855 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.796855 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:33.796947 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.797328 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:33.797335 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:33.798698 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:33.800431 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:33.800437 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:33.800439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:33.800652 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:33.800802 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:33.800802 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:33.800803 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:33.800878 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:33.801074 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:33.801078 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:33.801208 (+ 130us) client_negotiation.cc:769] Sending connection context
0619 02:44:33.801288 (+ 80us) client_negotiation.cc:240] Negotiation successful
0619 02:44:33.801392 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":87,"threads_started":1}
I20260619 02:44:33.802058 16887 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39743
I20260619 02:44:33.802152 16887 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:33.802317 16887 heartbeater.cc:511] Master 127.12.145.126:39743 requested a full tablet report, sending...
I20260619 02:44:33.802686 16428 ts_manager.cc:194] Registered new tserver with Master: d68ee60f4143490885bdb3503d55a03a (127.12.145.67:42099)
I20260619 02:44:33.802999 16428 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:40347
I20260619 02:44:33.811195 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:33.833388 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.825867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33428 (local address 127.12.145.65:38983)
0619 02:44:33.826025 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:33.826029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:33.826039 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:44:33.826061 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:33.826063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:33.826075 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:33.826146 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:33.826694 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.827381 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.828100 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.828399 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.828454 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.830462 (+ 2008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:33.830469 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:33.830469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:33.830475 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:33.832207 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.832540 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.832543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.832544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.832606 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.832830 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.832831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.832832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.832970 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:33.833118 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:33.833199 (+ 81us) server_negotiation.cc:299] Negotiation successful
0619 02:44:33.833275 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:33.840435 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:33.834506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44492 (local address 127.12.145.126:39743)
0619 02:44:33.834588 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:33.834590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:33.834629 (+ 39us) server_negotiation.cc:407] Connection header received
0619 02:44:33.834698 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:33.834699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:33.834707 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:33.834751 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:33.835144 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.835589 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.836190 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:33.836353 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:33.836398 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:33.838235 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:33.838237 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:33.838237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:33.838243 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:33.839579 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.839843 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.839844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.839844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.839890 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:33.840022 (+ 132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:33.840022 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:33.840023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:33.840135 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:33.840197 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:33.840286 (+ 89us) server_negotiation.cc:299] Negotiation successful
0619 02:44:33.840335 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260619 02:44:33.840674 16428 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44492
I20260619 02:44:33.840936 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 16490
I20260619 02:44:33.845279 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 16624
I20260619 02:44:33.849840 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 16758
I20260619 02:44:33.853574 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 16396
2026-06-19T02:44:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1804 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16899](info): set up 2 sockets
Jun 19 02:44:33 dist-test-slave-fbl4 krb5kdc[16899](info): commencing operation
krb5kdc: starting...
W20260619 02:44:34.886649 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:34 dist-test-slave-fbl4 krb5kdc[16899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:34.997040 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33005
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:33005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:35.075587 16912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:35.075780 16912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:35.075804 16912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:35.076875 16912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:35.076907 16912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:35.076920 16912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:35.076932 16912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:35.076944 16912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:35.078312 16912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:33005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:35.078485 16912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:35.078707 16912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:35.083209 16920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:35.083214 16918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:35.083218 16917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:35.083455 16912 server_base.cc:1034] running on GCE node
I20260619 02:44:35.083700 16912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:35.083986 16912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:35.085146 16912 hybrid_clock.cc:648] HybridClock initialized: now 1781837075085122 us; error 37 us; skew 500 ppm
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:35.087488 16912 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:35.087833 16912 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:35.087900 16912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:35.088047 16912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:35.089054 16912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "8225de8d645b4a37894d5ecf53d6c97e"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "d965a0a0f96c125a557664e9bef8b6f9"
server_key_iv: "ebfaf76ce82f2ee613196fce9717e6b6"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.089416 16912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "8225de8d645b4a37894d5ecf53d6c97e"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "d965a0a0f96c125a557664e9bef8b6f9"
server_key_iv: "ebfaf76ce82f2ee613196fce9717e6b6"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.090669 16912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:35.091387 16926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.091557 16912 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:35.091660 16912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "8225de8d645b4a37894d5ecf53d6c97e"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "d965a0a0f96c125a557664e9bef8b6f9"
server_key_iv: "ebfaf76ce82f2ee613196fce9717e6b6"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.091748 16912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:35.112568 16912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:35.115087 16912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:35.115252 16912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:35.118981 16912 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:33005
I20260619 02:44:35.119004 16978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:33005 every 8 connection(s)
I20260619 02:44:35.119298 16912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:35.120206 16979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:35.121090 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 16912
I20260619 02:44:35.121205 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:35.121395 12869 external_mini_cluster.cc:1428] Setting key f34f8a8ad34638707f5c4ec394d29cd3
I20260619 02:44:35.122830 16979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e: Bootstrap starting.
I20260619 02:44:35.123402 16979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:35.123689 16979 log.cc:824] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:35.124329 16979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e: No bootstrap required, opened a new log
I20260619 02:44:35.126098 16979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8225de8d645b4a37894d5ecf53d6c97e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33005 } }
I20260619 02:44:35.126284 16979 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:35.126338 16979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8225de8d645b4a37894d5ecf53d6c97e, State: Initialized, Role: FOLLOWER
I20260619 02:44:35.126466 16979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8225de8d645b4a37894d5ecf53d6c97e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33005 } }
I20260619 02:44:35.126545 16979 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:35.126607 16979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:35.126657 16979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:35.127167 16979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8225de8d645b4a37894d5ecf53d6c97e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33005 } }
I20260619 02:44:35.127276 16979 leader_election.cc:302] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8225de8d645b4a37894d5ecf53d6c97e; no voters:
I20260619 02:44:35.127419 16979 leader_election.cc:288] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:35.127480 16984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:35.127629 16984 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [term 1 LEADER]: Becoming Leader. State: Replica: 8225de8d645b4a37894d5ecf53d6c97e, State: Running, Role: LEADER
I20260619 02:44:35.127660 16979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [sys.catalog]: configured and running, proceeding with master startup.
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:35.129112 16984 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8225de8d645b4a37894d5ecf53d6c97e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33005 } }
I20260619 02:44:35.129699 16985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8225de8d645b4a37894d5ecf53d6c97e. Latest consensus state: current_term: 1 leader_uuid: "8225de8d645b4a37894d5ecf53d6c97e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8225de8d645b4a37894d5ecf53d6c97e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33005 } } }
I20260619 02:44:35.129752 16986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8225de8d645b4a37894d5ecf53d6c97e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8225de8d645b4a37894d5ecf53d6c97e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33005 } } }
W20260619 02:44:35.130250 16998 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:44:35.130532 16998 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:44:35.130522 16986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:35.130507 16985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:35.130821 17001 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:35.131008 17001 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:35.131963 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.121870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44072 (local address 127.12.145.126:33005)
0619 02:44:35.122050 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.122060 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.122097 (+ 37us) server_negotiation.cc:407] Connection header received
0619 02:44:35.122654 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.122662 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.122708 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.122845 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:35.123459 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.124445 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.125202 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.125597 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.125711 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.128246 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:35.128251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:35.128252 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:35.128264 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:35.130286 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.130707 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.130710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.130710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.130806 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.131034 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.131035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.131035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.131342 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:35.131503 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.131644 (+ 141us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.131777 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260619 02:44:35.132517 17001 catalog_manager.cc:1347] Generated new cluster ID: 450c5301160d4c8c907d5802af65f2f9
I20260619 02:44:35.132565 17001 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:35.146837 17001 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:35.147322 17001 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:35.151360 17001 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e: Generated new TSK 0
I20260619 02:44:35.151580 17001 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:35.182539 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33005
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:35.261535 17005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:35.261757 17005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:35.261794 17005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:35.262936 17005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:35.263002 17005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:35.263048 17005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:35.264514 17005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:35.264781 17005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:35.265000 17005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:35.269721 17011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:35.269739 17010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:35.269721 17013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:35.270017 17005 server_base.cc:1034] running on GCE node
I20260619 02:44:35.270237 17005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:35.270462 17005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:35.271634 17005 hybrid_clock.cc:648] HybridClock initialized: now 1781837075271618 us; error 32 us; skew 500 ppm
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:35.274092 17005 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:35.274471 17005 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:35.274520 17005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:35.274715 17005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:35.275738 17005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "9ac65b53c2b04f039d15c95f28d1b652"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "ecacd652a3cd6442afac63cc4c21c95c"
server_key_iv: "c4c766ecae68a297186e2f7db9142a20"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.276101 17005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "9ac65b53c2b04f039d15c95f28d1b652"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "ecacd652a3cd6442afac63cc4c21c95c"
server_key_iv: "c4c766ecae68a297186e2f7db9142a20"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.277333 17005 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:35.277989 17019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.278158 17005 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:35.278241 17005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "9ac65b53c2b04f039d15c95f28d1b652"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "ecacd652a3cd6442afac63cc4c21c95c"
server_key_iv: "c4c766ecae68a297186e2f7db9142a20"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.278293 17005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:35.292361 17005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:35.294184 17005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:35.294332 17005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:35.294600 17005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:35.294935 17005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:35.294971 17005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.294993 17005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:35.295039 17005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.300544 17005 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:34667
I20260619 02:44:35.300657 17132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:34667 every 8 connection(s)
I20260619 02:44:35.300907 17005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:35.307211 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17005
I20260619 02:44:35.307322 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:35.307514 12869 external_mini_cluster.cc:1428] Setting key c686fc7889e74e68858649e6660be376
I20260619 02:44:35.310114 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.301603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:56573 (local address 127.12.145.126:33005)
0619 02:44:35.301675 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.301677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.301869 (+ 192us) server_negotiation.cc:407] Connection header received
0619 02:44:35.302323 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.302324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.302333 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.302388 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:35.303328 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.303816 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.304735 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.304921 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.304972 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.306971 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:35.306972 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:35.306972 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:35.306978 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:35.308563 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.309048 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.309049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.309050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.309108 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.309375 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.309375 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.309375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.309536 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:35.309613 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.309878 (+ 265us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.309967 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 02:44:35.310124 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.301571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33005 (local address 127.12.145.65:56573)
0619 02:44:35.301734 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.301774 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.302241 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.302442 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.302445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.302758 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:35.303244 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.303249 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.303891 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.303892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.304666 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.304667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.304988 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.304989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.305093 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.305592 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:35.305600 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:35.306892 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:35.308656 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:35.308662 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:35.308664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:35.308976 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:35.309172 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:35.309173 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:35.309173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:35.309312 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:35.309611 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:35.309617 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:35.309757 (+ 140us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.309840 (+ 83us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.309951 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":83,"threads_started":1}
I20260619 02:44:35.311059 17133 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33005
I20260619 02:44:35.311167 17133 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:35.311314 17133 heartbeater.cc:511] Master 127.12.145.126:33005 requested a full tablet report, sending...
I20260619 02:44:35.311795 16943 ts_manager.cc:194] Registered new tserver with Master: 9ac65b53c2b04f039d15c95f28d1b652 (127.12.145.65:34667)
I20260619 02:44:35.312405 16943 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:56573
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:35.331528 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33005
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:35.409729 17138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:35.409914 17138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:35.409936 17138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:35.411029 17138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:35.411063 17138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:35.411089 17138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:35.412467 17138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:35.412652 17138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:35.412810 17138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:35.417537 17146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:35.417680 17138 server_base.cc:1034] running on GCE node
W20260619 02:44:35.417601 17144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:35.417538 17143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:35.418051 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:35.418300 17138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:35.419466 17138 hybrid_clock.cc:648] HybridClock initialized: now 1781837075419453 us; error 46 us; skew 500 ppm
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:35.421864 17138 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:35.422237 17138 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:35.422309 17138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:35.422444 17138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:35.423475 17138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "e631133160a64dacad2f002cca41c893"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "4f2941a0d3468aae443057f66c1e3ce3"
server_key_iv: "7324b76340f83393500a10811c786736"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.423830 17138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "e631133160a64dacad2f002cca41c893"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "4f2941a0d3468aae443057f66c1e3ce3"
server_key_iv: "7324b76340f83393500a10811c786736"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.425128 17138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:44:35.425830 17152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.426036 17138 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:35.426134 17138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "e631133160a64dacad2f002cca41c893"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "4f2941a0d3468aae443057f66c1e3ce3"
server_key_iv: "7324b76340f83393500a10811c786736"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.426218 17138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:35.458771 17138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:35.460623 17138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:35.460783 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:35.461019 17138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:35.461369 17138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:35.461424 17138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.461459 17138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:35.461485 17138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.467233 17138 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:46319
I20260619 02:44:35.467273 17265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:46319 every 8 connection(s)
I20260619 02:44:35.467532 17138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:35.476038 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17138
I20260619 02:44:35.476132 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:35.476141 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.468232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:35209 (local address 127.12.145.126:33005)
0619 02:44:35.468298 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.468300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.468488 (+ 188us) server_negotiation.cc:407] Connection header received
0619 02:44:35.468978 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.468980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.468991 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.469052 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:35.469925 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.470424 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.471382 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.471595 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.471652 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.473542 (+ 1890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:35.473543 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:35.473543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:35.473550 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:35.474989 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.475314 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.475315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.475315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.475362 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.475566 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.475567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.475567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.475667 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:35.475718 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.475952 (+ 234us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.476032 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260619 02:44:35.476284 17268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.468204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33005 (local address 127.12.145.66:35209)
0619 02:44:35.468357 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.468397 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.468860 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.469103 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.469106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.469356 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:35.469839 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.469844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.470505 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.470506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.471309 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.471312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.471668 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.471668 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.471762 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.472167 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:35.472175 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:35.473460 (+ 1285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:35.475054 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:35.475058 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:35.475060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:35.475251 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:35.475417 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:35.475418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:35.475418 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:35.475513 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:35.475721 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:35.475725 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:35.475825 (+ 100us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.475904 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.476009 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260619 02:44:35.476344 12869 external_mini_cluster.cc:1428] Setting key 65036b8af96ca0846e1a7ddc463416c9
I20260619 02:44:35.476814 17266 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33005
I20260619 02:44:35.476905 17266 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:35.477092 17266 heartbeater.cc:511] Master 127.12.145.126:33005 requested a full tablet report, sending...
I20260619 02:44:35.478729 16942 ts_manager.cc:194] Registered new tserver with Master: e631133160a64dacad2f002cca41c893 (127.12.145.66:46319)
I20260619 02:44:35.479094 16942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:35209
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:35.498839 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33005
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:35.578037 17271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:35.578250 17271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:35.578285 17271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:35.579461 17271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:35.579538 17271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:35.579593 17271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:35.581193 17271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:35.581441 17271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:35.581662 17271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:35.586383 17276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:35.586390 17277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:35.586396 17279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:35.586758 17271 server_base.cc:1034] running on GCE node
I20260619 02:44:35.586989 17271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:35.587221 17271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:35.588358 17271 hybrid_clock.cc:648] HybridClock initialized: now 1781837075588337 us; error 33 us; skew 500 ppm
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:35.590729 17271 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:35.591054 17271 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:35.591122 17271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:35.591249 17271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:35.592227 17271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "85b4e2fa95f549e58250ee60abc04f4e"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "61e598f56ba0908989eb0aca02e1c39d"
server_key_iv: "dea7f7119d22707b6055918030898993"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.592582 17271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "85b4e2fa95f549e58250ee60abc04f4e"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "61e598f56ba0908989eb0aca02e1c39d"
server_key_iv: "dea7f7119d22707b6055918030898993"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.593847 17271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:35.594631 17285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.594779 17271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:35.594880 17271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "85b4e2fa95f549e58250ee60abc04f4e"
format_stamp: "Formatted at 2026-06-19 02:44:35 on dist-test-slave-fbl4"
server_key: "61e598f56ba0908989eb0aca02e1c39d"
server_key_iv: "dea7f7119d22707b6055918030898993"
server_key_version: "encryptionkey@0"
I20260619 02:44:35.594940 17271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:35.610739 17271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:35.612409 17271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:35.612514 17271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:35.612680 17271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:35.612913 17271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:35.612942 17271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.612962 17271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:35.612974 17271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:35.618424 17271 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:34267
I20260619 02:44:35.618510 17398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:34267 every 8 connection(s)
I20260619 02:44:35.618773 17271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:44:35.622951 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17271
I20260619 02:44:35.623077 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:35.623270 12869 external_mini_cluster.cc:1428] Setting key 4bcfb2df418abaa3a3c120e028cbe9b7
Jun 19 02:44:35 dist-test-slave-fbl4 krb5kdc[16899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:35.627229 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.619451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:33147 (local address 127.12.145.126:33005)
0619 02:44:35.619511 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.619513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.619729 (+ 216us) server_negotiation.cc:407] Connection header received
0619 02:44:35.620148 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.620148 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.620157 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.620207 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:35.621038 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.621510 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.622419 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.622661 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.622707 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.624969 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:35.624970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:35.624970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:35.624976 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:35.626118 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.626446 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.626446 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.626447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.626494 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.626747 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.626747 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.626747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.626842 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:35.626894 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.627114 (+ 220us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.627170 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:44:35.627391 17401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.619434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33005 (local address 127.12.145.67:33147)
0619 02:44:35.619598 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.619637 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.620075 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.620263 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.620266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.620500 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:35.620969 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.620974 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.621584 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.621584 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.622351 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.622353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.622725 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.622725 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.622838 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.623348 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:35.623356 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:35.624896 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:35.626186 (+ 1290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:35.626191 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:35.626192 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:35.626387 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:35.626587 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:35.626588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:35.626588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:35.626693 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:35.626897 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:35.626901 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:35.626999 (+ 98us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.627093 (+ 94us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.627222 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260619 02:44:35.627840 17399 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33005
I20260619 02:44:35.627938 17399 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:35.628075 17399 heartbeater.cc:511] Master 127.12.145.126:33005 requested a full tablet report, sending...
I20260619 02:44:35.628458 16942 ts_manager.cc:194] Registered new tserver with Master: 85b4e2fa95f549e58250ee60abc04f4e (127.12.145.67:34267)
I20260619 02:44:35.628849 16942 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:33147
I20260619 02:44:35.635206 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:44:35.642411 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.636705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.12.145.126:33005)
0619 02:44:35.636773 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.636775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.636844 (+ 69us) server_negotiation.cc:407] Connection header received
0619 02:44:35.636915 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.636916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.636925 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.636979 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:35.637489 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.637949 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.638727 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.638911 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.638982 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.640097 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:35.640098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:35.640099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:35.640105 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:35.641298 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.641646 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.641647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.641648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.641705 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:35.641900 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:35.641901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:35.641901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:35.642035 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:35.642137 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.642243 (+ 106us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.642317 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 02:44:35.643805 16942 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:44:35.645303 16942 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:35.651199 17408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.647228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:34667 (local address 127.0.0.1:53972)
0619 02:44:35.647379 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.647418 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.647481 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.647815 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.647819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.647821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:35.647889 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.647891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.648920 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.648921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.650076 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.650078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.650918 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.650919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.650996 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.651000 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.651080 (+ 80us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.651119 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":54,"threads_started":1}
I20260619 02:44:35.651211 17412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.647480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53972 (local address 127.12.145.65:34667)
0619 02:44:35.647625 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.647630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.647640 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:44:35.647682 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.647684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.647699 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.647963 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:35.648045 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.648819 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.650170 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.650835 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.650917 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.650973 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.651086 (+ 113us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.651127 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260619 02:44:35.651403 17409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.647235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:46319 (local address 127.0.0.1:56008)
0619 02:44:35.647651 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.647661 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.647715 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.647931 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.647932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.647933 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:35.647970 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.647971 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.649245 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.649246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.650079 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.650081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.650907 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.650909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.650986 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.650999 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.651045 (+ 46us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.651091 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":50,"threads_started":1}
I20260619 02:44:35.651571 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.647235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:34267 (local address 127.0.0.1:33272)
0619 02:44:35.647811 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.647819 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.647862 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.648068 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.648069 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.648071 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:35.648111 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.648112 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.649361 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.649362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.650416 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.650418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.651341 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.651342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.651401 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.651404 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.651447 (+ 43us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.651484 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":2,"thread_start_us":49,"threads_started":1}
I20260619 02:44:35.651784 17410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.647361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33272 (local address 127.12.145.67:34267)
0619 02:44:35.647632 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.647635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.647876 (+ 241us) server_negotiation.cc:407] Connection header received
0619 02:44:35.647914 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.647917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.647929 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.648184 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:35.648256 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.649261 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.650495 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.651193 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.651254 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.651303 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.651676 (+ 373us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.651713 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":68,"threads_started":1}
I20260619 02:44:35.651935 17067 tablet_service.cc:1467] Processing CreateTablet for tablet 1abb52dcdd24459f87929bf72267a3c8 (DEFAULT_TABLE table=test-table [id=f4998c62492a451f9aa23b3c13c971d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:35.652220 17067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1abb52dcdd24459f87929bf72267a3c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:35.652319 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.647457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56008 (local address 127.12.145.66:46319)
0619 02:44:35.647608 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.647613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.647711 (+ 98us) server_negotiation.cc:407] Connection header received
0619 02:44:35.647798 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.647799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.647811 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.647933 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:35.648017 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.649132 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.650173 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.650813 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.651167 (+ 354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.651229 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.651747 (+ 518us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.652193 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260619 02:44:35.652410 17333 tablet_service.cc:1467] Processing CreateTablet for tablet 1abb52dcdd24459f87929bf72267a3c8 (DEFAULT_TABLE table=test-table [id=f4998c62492a451f9aa23b3c13c971d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:35.652725 17333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1abb52dcdd24459f87929bf72267a3c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:35.652984 17200 tablet_service.cc:1467] Processing CreateTablet for tablet 1abb52dcdd24459f87929bf72267a3c8 (DEFAULT_TABLE table=test-table [id=f4998c62492a451f9aa23b3c13c971d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:35.653270 17200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1abb52dcdd24459f87929bf72267a3c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:35.654666 17413 tablet_bootstrap.cc:492] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652: Bootstrap starting.
I20260619 02:44:35.655364 17413 tablet_bootstrap.cc:654] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:35.655838 17413 log.cc:824] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:35.655908 17414 tablet_bootstrap.cc:492] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Bootstrap starting.
I20260619 02:44:35.656454 17414 tablet_bootstrap.cc:654] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:35.656620 17413 tablet_bootstrap.cc:492] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652: No bootstrap required, opened a new log
I20260619 02:44:35.656692 17413 ts_tablet_manager.cc:1397] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260619 02:44:35.656646 17416 tablet_bootstrap.cc:492] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Bootstrap starting.
I20260619 02:44:35.657109 17414 log.cc:824] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:35.657224 17416 tablet_bootstrap.cc:654] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:35.657687 17416 log.cc:824] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:35.658358 17416 tablet_bootstrap.cc:492] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: No bootstrap required, opened a new log
I20260619 02:44:35.658434 17416 ts_tablet_manager.cc:1397] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:35.658614 17413 raft_consensus.cc:348] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.658815 17413 raft_consensus.cc:374] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:35.658865 17413 raft_consensus.cc:729] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac65b53c2b04f039d15c95f28d1b652, State: Initialized, Role: FOLLOWER
I20260619 02:44:35.658987 17413 consensus_queue.cc:260] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.659149 17414 tablet_bootstrap.cc:492] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: No bootstrap required, opened a new log
I20260619 02:44:35.659202 17414 ts_tablet_manager.cc:1397] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260619 02:44:35.659277 17133 heartbeater.cc:503] Master 127.12.145.126:33005 was elected leader, sending a full tablet report...
I20260619 02:44:35.659502 17413 ts_tablet_manager.cc:1428] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260619 02:44:35.660442 17416 raft_consensus.cc:348] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.660563 17416 raft_consensus.cc:374] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:35.660584 17416 raft_consensus.cc:729] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e631133160a64dacad2f002cca41c893, State: Initialized, Role: FOLLOWER
I20260619 02:44:35.660686 17416 consensus_queue.cc:260] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.660895 17416 ts_tablet_manager.cc:1428] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 02:44:35.660807 17414 raft_consensus.cc:348] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.660972 17266 heartbeater.cc:503] Master 127.12.145.126:33005 was elected leader, sending a full tablet report...
I20260619 02:44:35.660980 17414 raft_consensus.cc:374] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:35.661007 17414 raft_consensus.cc:729] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b4e2fa95f549e58250ee60abc04f4e, State: Initialized, Role: FOLLOWER
I20260619 02:44:35.661079 17414 consensus_queue.cc:260] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.661314 17414 ts_tablet_manager.cc:1428] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:35.661336 17399 heartbeater.cc:503] Master 127.12.145.126:33005 was elected leader, sending a full tablet report...
W20260619 02:44:35.718114 17267 tablet.cc:2369] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:44:35.801592 17134 tablet.cc:2369] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:44:35.836655 17419 raft_consensus.cc:482] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:35.836793 17419 raft_consensus.cc:504] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.837175 17419 leader_election.cc:288] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85b4e2fa95f549e58250ee60abc04f4e (127.12.145.67:34267), e631133160a64dacad2f002cca41c893 (127.12.145.66:46319)
I20260619 02:44:35.840101 17410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.837407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:52585 (local address 127.12.145.67:34267)
0619 02:44:35.837453 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.837455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.837595 (+ 140us) server_negotiation.cc:407] Connection header received
0619 02:44:35.837660 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.837661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.837671 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.837725 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:35.837914 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.838400 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.839361 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.839765 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.839821 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.839828 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.839984 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.840024 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:44:35.840117 17423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.837364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:34267 (local address 127.12.145.65:52585)
0619 02:44:35.837502 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.837512 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.837580 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.837746 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.837747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.837750 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:35.837826 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.837828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.838477 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.838478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.839268 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.839270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.839844 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.839845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.839913 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.839916 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.839969 (+ 53us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.839999 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260619 02:44:35.840186 17411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.837448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:40049 (local address 127.12.145.66:46319)
0619 02:44:35.837493 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.837495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.837624 (+ 129us) server_negotiation.cc:407] Connection header received
0619 02:44:35.837682 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.837683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.837696 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.837764 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:35.837990 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.838427 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.839428 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.839782 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.839870 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.839878 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.840075 (+ 197us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.840113 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:44:35.840415 17422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.837381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:46319 (local address 127.12.145.65:40049)
0619 02:44:35.837514 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.837524 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:35.837617 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:35.837780 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:35.837781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:35.837782 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:35.837898 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.837900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.838527 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.838528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.839336 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:35.839339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.839885 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.839886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:35.839993 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.839997 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:35.840054 (+ 57us) client_negotiation.cc:240] Negotiation successful
0619 02:44:35.840090 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
I20260619 02:44:35.840420 17353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abb52dcdd24459f87929bf72267a3c8" candidate_uuid: "9ac65b53c2b04f039d15c95f28d1b652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b4e2fa95f549e58250ee60abc04f4e" is_pre_election: true
I20260619 02:44:35.840598 17353 raft_consensus.cc:2454] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac65b53c2b04f039d15c95f28d1b652 in term 0.
I20260619 02:44:35.840816 17020 leader_election.cc:302] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b4e2fa95f549e58250ee60abc04f4e, 9ac65b53c2b04f039d15c95f28d1b652; no voters:
I20260619 02:44:35.840792 17220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abb52dcdd24459f87929bf72267a3c8" candidate_uuid: "9ac65b53c2b04f039d15c95f28d1b652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e631133160a64dacad2f002cca41c893" is_pre_election: true
I20260619 02:44:35.840929 17220 raft_consensus.cc:2454] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ac65b53c2b04f039d15c95f28d1b652 in term 0.
I20260619 02:44:35.841039 17419 raft_consensus.cc:2781] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:35.841113 17419 raft_consensus.cc:482] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:35.841138 17419 raft_consensus.cc:3037] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:35.841830 17419 raft_consensus.cc:504] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.841962 17419 leader_election.cc:288] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [CANDIDATE]: Term 1 election: Requested vote from peers 85b4e2fa95f549e58250ee60abc04f4e (127.12.145.67:34267), e631133160a64dacad2f002cca41c893 (127.12.145.66:46319)
I20260619 02:44:35.842105 17353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abb52dcdd24459f87929bf72267a3c8" candidate_uuid: "9ac65b53c2b04f039d15c95f28d1b652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85b4e2fa95f549e58250ee60abc04f4e"
I20260619 02:44:35.842177 17353 raft_consensus.cc:3037] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:35.842620 17220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abb52dcdd24459f87929bf72267a3c8" candidate_uuid: "9ac65b53c2b04f039d15c95f28d1b652" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e631133160a64dacad2f002cca41c893"
I20260619 02:44:35.842718 17220 raft_consensus.cc:3037] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:35.842873 17353 raft_consensus.cc:2454] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac65b53c2b04f039d15c95f28d1b652 in term 1.
I20260619 02:44:35.843031 17020 leader_election.cc:302] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b4e2fa95f549e58250ee60abc04f4e, 9ac65b53c2b04f039d15c95f28d1b652; no voters:
I20260619 02:44:35.843133 17419 raft_consensus.cc:2781] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:35.843318 17419 raft_consensus.cc:686] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac65b53c2b04f039d15c95f28d1b652, State: Running, Role: LEADER
I20260619 02:44:35.843434 17419 consensus_queue.cc:237] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } }
I20260619 02:44:35.843650 17220 raft_consensus.cc:2454] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ac65b53c2b04f039d15c95f28d1b652 in term 1.
I20260619 02:44:35.844256 16942 catalog_manager.cc:5495] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ac65b53c2b04f039d15c95f28d1b652 (127.12.145.65). New cstate: current_term: 1 leader_uuid: "9ac65b53c2b04f039d15c95f28d1b652" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac65b53c2b04f039d15c95f28d1b652" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 34667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 } health_report { overall_health: UNKNOWN } } }
W20260619 02:44:35.869454 17400 tablet.cc:2369] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:44:35.876153 17412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.873921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53976 (local address 127.12.145.65:34667)
0619 02:44:35.873981 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:35.873985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:35.873998 (+ 13us) server_negotiation.cc:407] Connection header received
0619 02:44:35.874031 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:35.874032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:35.874048 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:35.874115 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:35.874240 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.874769 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.875471 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:35.875650 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:35.875700 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:35.875834 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:35.875927 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:35.875986 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:35.876030 (+ 44us) server_negotiation.cc:299] Negotiation successful
0619 02:44:35.876046 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:44:35.877925 17353 raft_consensus.cc:1261] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 1 FOLLOWER]: Refusing update from remote peer 9ac65b53c2b04f039d15c95f28d1b652: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:35.877964 17220 raft_consensus.cc:1261] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 1 FOLLOWER]: Refusing update from remote peer 9ac65b53c2b04f039d15c95f28d1b652: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:35.878271 17424 consensus_queue.cc:1035] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85b4e2fa95f549e58250ee60abc04f4e" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 34267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:35.878398 17419 consensus_queue.cc:1035] T 1abb52dcdd24459f87929bf72267a3c8 P 9ac65b53c2b04f039d15c95f28d1b652 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e631133160a64dacad2f002cca41c893" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:35.880780 17427 mvcc.cc:205] Tried to move back new op lower bound from 7298404662793248768 to 7298404662655377408. Current Snapshot: MvccSnapshot[applied={T|T < 7298404662793248768}]
I20260619 02:44:35.880936 17428 mvcc.cc:205] Tried to move back new op lower bound from 7298404662793248768 to 7298404662655377408. Current Snapshot: MvccSnapshot[applied={T|T < 7298404662793248768}]
I20260619 02:44:35.881966 17429 mvcc.cc:205] Tried to move back new op lower bound from 7298404662793248768 to 7298404662655377408. Current Snapshot: MvccSnapshot[applied={T|T < 7298404662793248768 or (T in {7298404662793248768})}]
I20260619 02:44:35.883078 16942 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:35.883169 16942 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:35.883842 16942 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8225de8d645b4a37894d5ecf53d6c97e: Sending DeleteTablet for 3 replicas of tablet 1abb52dcdd24459f87929bf72267a3c8
I20260619 02:44:35.884126 17333 tablet_service.cc:1514] Processing DeleteTablet for tablet 1abb52dcdd24459f87929bf72267a3c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:35 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:33272
I20260619 02:44:35.884186 17200 tablet_service.cc:1514] Processing DeleteTablet for tablet 1abb52dcdd24459f87929bf72267a3c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:35 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:56008
I20260619 02:44:35.884325 17437 tablet_replica.cc:330] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: stopping tablet replica
I20260619 02:44:35.884413 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17005
I20260619 02:44:35.884536 17437 raft_consensus.cc:2229] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:35.884991 17437 raft_consensus.cc:2258] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:35.885279 17438 tablet_replica.cc:330] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: stopping tablet replica
I20260619 02:44:35.885361 17438 raft_consensus.cc:2229] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:35.885381 17437 ts_tablet_manager.cc:1905] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:35.885442 17438 raft_consensus.cc:2258] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:35.886158 17438 ts_tablet_manager.cc:1905] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:35.886940 17437 ts_tablet_manager.cc:1918] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:35.887013 17437 log.cc:1196] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/1abb52dcdd24459f87929bf72267a3c8
I20260619 02:44:35.887297 17437 ts_tablet_manager.cc:1939] T 1abb52dcdd24459f87929bf72267a3c8 P 85b4e2fa95f549e58250ee60abc04f4e: Deleting consensus metadata
I20260619 02:44:35.887744 16927 catalog_manager.cc:4841] TS 85b4e2fa95f549e58250ee60abc04f4e (127.12.145.67:34267): tablet 1abb52dcdd24459f87929bf72267a3c8 (table test-table [id=f4998c62492a451f9aa23b3c13c971d4]) successfully deleted
I20260619 02:44:35.887784 17438 ts_tablet_manager.cc:1918] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:35.887841 17438 log.cc:1196] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/1abb52dcdd24459f87929bf72267a3c8
I20260619 02:44:35.888087 17438 ts_tablet_manager.cc:1939] T 1abb52dcdd24459f87929bf72267a3c8 P e631133160a64dacad2f002cca41c893: Deleting consensus metadata
I20260619 02:44:35.888463 16928 catalog_manager.cc:4841] TS e631133160a64dacad2f002cca41c893 (127.12.145.66:46319): tablet 1abb52dcdd24459f87929bf72267a3c8 (table test-table [id=f4998c62492a451f9aa23b3c13c971d4]) successfully deleted
W20260619 02:44:35.890512 16930 connection.cc:535] client connection to 127.12.145.65:34667 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 02:44:35.890650 16930 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 02:44:35.890686 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17138
I20260619 02:44:35.891392 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:35.891292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:34667 (local address 127.0.0.1:53984)
0619 02:44:35.891329 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:35.891368 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:34667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260619 02:44:35.891541 16930 catalog_manager.cc:4584] TS 9ac65b53c2b04f039d15c95f28d1b652 (127.12.145.65:34667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1abb52dcdd24459f87929bf72267a3c8: Network error: Client connection negotiation failed: client connection to 127.12.145.65:34667: connect: Connection refused (error 111)
I20260619 02:44:35.896164 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17271
I20260619 02:44:35.900825 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 16912
2026-06-19T02:44:35Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2048 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-06-19T02:44:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:35Z Disabled control of system clock
I20260619 02:44:35.927874 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34811
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:34965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 02:44:36.006757 17443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:36.006947 17443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:36.006975 17443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:36.008067 17443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:36.008101 17443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:36.008114 17443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:36.008127 17443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:36.008139 17443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:36.009393 17443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34811
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:36.009582 17443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:36.009806 17443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:36.014384 17449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.014390 17451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.014410 17443 server_base.cc:1034] running on GCE node
W20260619 02:44:36.014384 17448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.014894 17443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:36.015142 17443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:36.016288 17443 hybrid_clock.cc:648] HybridClock initialized: now 1781837076016264 us; error 37 us; skew 500 ppm
I20260619 02:44:36.017545 17443 webserver.cc:460] Webserver started at http://127.12.145.126:37371/ using document root <none> and password file <none>
I20260619 02:44:36.017743 17443 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:36.017784 17443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:36.017872 17443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:36.018921 17443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "1d5f914320dc4063ac4aa4fb0997ec16"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "f8348e13afc1579a3b8ca3665eea94d1"
server_key_iv: "5e8797c2175b2fc78f756a22d8ad28d7"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.019227 17443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "1d5f914320dc4063ac4aa4fb0997ec16"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "f8348e13afc1579a3b8ca3665eea94d1"
server_key_iv: "5e8797c2175b2fc78f756a22d8ad28d7"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.020498 17443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:36.021193 17457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.021562 17443 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:36.021658 17443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "1d5f914320dc4063ac4aa4fb0997ec16"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "f8348e13afc1579a3b8ca3665eea94d1"
server_key_iv: "5e8797c2175b2fc78f756a22d8ad28d7"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.021729 17443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:36.025058 17443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:36.025310 17443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:36.025460 17443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:36.029212 17443 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:34811
I20260619 02:44:36.029240 17509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:34811 every 8 connection(s)
I20260619 02:44:36.029574 17443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:36.030174 17510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:36.031527 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17443
I20260619 02:44:36.031656 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:36.031838 12869 external_mini_cluster.cc:1428] Setting key d21ea43985eb7db011a6894c74c0befb
I20260619 02:44:36.033133 17510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16: Bootstrap starting.
I20260619 02:44:36.033879 17510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:36.034215 17510 log.cc:824] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:36.034508 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.032374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52616 (local address 127.12.145.126:34811)
0619 02:44:36.032547 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.032554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.032578 (+ 24us) server_negotiation.cc:407] Connection header received
0619 02:44:36.032976 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.032985 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.033022 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.033135 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.033894 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.033897 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.033898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.033901 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.033966 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.033982 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.034087 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.034144 (+ 57us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.034198 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260619 02:44:36.035034 17510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16: No bootstrap required, opened a new log
I20260619 02:44:36.036365 17510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34811 } }
I20260619 02:44:36.036489 17510 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:36.036509 17510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5f914320dc4063ac4aa4fb0997ec16, State: Initialized, Role: FOLLOWER
I20260619 02:44:36.036657 17510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34811 } }
I20260619 02:44:36.036743 17510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:36.036785 17510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:36.036834 17510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:36.037560 17510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34811 } }
I20260619 02:44:36.037674 17510 leader_election.cc:302] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d5f914320dc4063ac4aa4fb0997ec16; no voters:
I20260619 02:44:36.037823 17510 leader_election.cc:288] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:36.037884 17515 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:36.038056 17515 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5f914320dc4063ac4aa4fb0997ec16, State: Running, Role: LEADER
I20260619 02:44:36.038092 17510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:36.038156 17515 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34811 } }
I20260619 02:44:36.038532 17516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34811 } } }
I20260619 02:44:36.038535 17517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d5f914320dc4063ac4aa4fb0997ec16. Latest consensus state: current_term: 1 leader_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d5f914320dc4063ac4aa4fb0997ec16" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34811 } } }
I20260619 02:44:36.038722 17516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:36.038733 17517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:36.039183 17524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:36.039642 17524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:36.041074 17524 catalog_manager.cc:1347] Generated new cluster ID: 3513583cbbb34e8c856be7d530279ae9
I20260619 02:44:36.041131 17524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:36.049710 17524 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:36.049865 17524 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:36.053164 17524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16: Generated new TSK 0
I20260619 02:44:36.053339 17524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:44:36.060307 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34811
--builtin_ntp_servers=127.12.145.84:34965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 02:44:36.140872 17534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:36.141057 17534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:36.141080 17534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:36.142207 17534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:36.142246 17534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:36.142269 17534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:36.144172 17534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:36.144395 17534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:36.144687 17534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:36.150461 17539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.150462 17540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.150640 17534 server_base.cc:1034] running on GCE node
W20260619 02:44:36.150760 17542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.151145 17534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:36.151427 17534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:36.152583 17534 hybrid_clock.cc:648] HybridClock initialized: now 1781837076152571 us; error 27 us; skew 500 ppm
I20260619 02:44:36.153828 17534 webserver.cc:460] Webserver started at http://127.12.145.65:41455/ using document root <none> and password file <none>
I20260619 02:44:36.154058 17534 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:36.154134 17534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:36.154269 17534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:36.155354 17534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "35677f74a2ca41dead63d38a1b0de28a"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "4d5701691d99bde0bd53959b74aa533f"
server_key_iv: "c168249b917dbbd02b320b949c3ed699"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.155714 17534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "35677f74a2ca41dead63d38a1b0de28a"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "4d5701691d99bde0bd53959b74aa533f"
server_key_iv: "c168249b917dbbd02b320b949c3ed699"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.156991 17534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:44:36.157725 17548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.157948 17534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:44:36.158042 17534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "35677f74a2ca41dead63d38a1b0de28a"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "4d5701691d99bde0bd53959b74aa533f"
server_key_iv: "c168249b917dbbd02b320b949c3ed699"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.158109 17534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:36.162961 17534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:36.163215 17534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:36.163332 17534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:36.163528 17534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:36.163818 17534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:36.163854 17534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.163882 17534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:36.163905 17534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.170807 17534 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:38729
I20260619 02:44:36.170835 17661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:38729 every 8 connection(s)
I20260619 02:44:36.171187 17534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:36.174137 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.171973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:51083 (local address 127.12.145.126:34811)
0619 02:44:36.172041 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.172044 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.172303 (+ 259us) server_negotiation.cc:407] Connection header received
0619 02:44:36.172735 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.172737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.172752 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.172837 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.173931 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.173932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.173932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.173936 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.173950 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.173953 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.174005 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.174067 (+ 62us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.174080 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:44:36.174317 17664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.171955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34811 (local address 127.12.145.65:51083)
0619 02:44:36.172172 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.172208 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.172640 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.172885 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.172888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.172896 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.173796 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.173797 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.173822 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.173849 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.174007 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.174008 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.174011 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.174059 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.174107 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":111,"threads_started":1}
I20260619 02:44:36.174906 17662 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34811
I20260619 02:44:36.175031 17662 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:36.175181 17662 heartbeater.cc:511] Master 127.12.145.126:34811 requested a full tablet report, sending...
I20260619 02:44:36.175200 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17534
I20260619 02:44:36.175288 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:36.175655 12869 external_mini_cluster.cc:1428] Setting key 677d2b4337b397ca9779bfb15e807915
I20260619 02:44:36.175765 17474 ts_manager.cc:194] Registered new tserver with Master: 35677f74a2ca41dead63d38a1b0de28a (127.12.145.65:38729)
I20260619 02:44:36.176700 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34811
--builtin_ntp_servers=127.12.145.84:34965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 02:44:36.255656 17665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:36.255862 17665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:36.255896 17665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:36.257040 17665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:36.257099 17665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:36.257140 17665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:36.258419 17665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:36.258695 17665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:36.258963 17665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:36.263829 17673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.263767 17670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.263963 17665 server_base.cc:1034] running on GCE node
W20260619 02:44:36.263763 17671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.264223 17665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:36.264451 17665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:36.265615 17665 hybrid_clock.cc:648] HybridClock initialized: now 1781837076265601 us; error 38 us; skew 500 ppm
I20260619 02:44:36.266855 17665 webserver.cc:460] Webserver started at http://127.12.145.66:40583/ using document root <none> and password file <none>
I20260619 02:44:36.267091 17665 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:36.267158 17665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:36.267290 17665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:36.268303 17665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "87a9f9b9c9394e42bff50ab8f58ab213"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "46539e73d721bdc34cb7015386da235e"
server_key_iv: "97c3ad5f851ab09cff4fb645a43e8905"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.268653 17665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "87a9f9b9c9394e42bff50ab8f58ab213"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "46539e73d721bdc34cb7015386da235e"
server_key_iv: "97c3ad5f851ab09cff4fb645a43e8905"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.269857 17665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:36.270601 17679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.270771 17665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:36.270862 17665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "87a9f9b9c9394e42bff50ab8f58ab213"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "46539e73d721bdc34cb7015386da235e"
server_key_iv: "97c3ad5f851ab09cff4fb645a43e8905"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.270946 17665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:36.274191 17665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:36.274457 17665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:36.274621 17665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:36.274824 17665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:36.275123 17665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:36.275177 17665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.275216 17665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:36.275243 17665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.280838 17665 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:33353
I20260619 02:44:36.280871 17792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:33353 every 8 connection(s)
I20260619 02:44:36.281213 17665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:36.284168 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.281960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:56469 (local address 127.12.145.126:34811)
0619 02:44:36.282024 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.282026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.282260 (+ 234us) server_negotiation.cc:407] Connection header received
0619 02:44:36.282771 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.282772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.282777 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.282824 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.283998 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.283999 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.283999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.284001 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.284011 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.284014 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.284054 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.284104 (+ 50us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.284115 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:44:36.284340 17795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.281943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34811 (local address 127.12.145.66:56469)
0619 02:44:36.282136 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.282168 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.282674 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.282883 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.282886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.282893 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.283866 (+ 973us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.283867 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.283894 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.283921 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.284054 (+ 133us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.284056 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.284059 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.284104 (+ 45us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.284149 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":103,"threads_started":1}
I20260619 02:44:36.284798 17793 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34811
I20260619 02:44:36.284885 17793 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:36.284996 17793 heartbeater.cc:511] Master 127.12.145.126:34811 requested a full tablet report, sending...
I20260619 02:44:36.285326 17473 ts_manager.cc:194] Registered new tserver with Master: 87a9f9b9c9394e42bff50ab8f58ab213 (127.12.145.66:33353)
I20260619 02:44:36.290961 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17665
I20260619 02:44:36.291035 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:36.291219 12869 external_mini_cluster.cc:1428] Setting key 6c79b459fd0b97e9669d2b79acf00974
I20260619 02:44:36.292160 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34811
--builtin_ntp_servers=127.12.145.84:34965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 02:44:36.370190 17796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:36.370373 17796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:36.370394 17796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:36.371622 17796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:36.371660 17796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:36.371685 17796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:36.372960 17796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:36.373208 17796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:36.373489 17796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:36.378387 17801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.378365 17804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.378620 17802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.378651 17796 server_base.cc:1034] running on GCE node
I20260619 02:44:36.378882 17796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:36.379173 17796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:36.380321 17796 hybrid_clock.cc:648] HybridClock initialized: now 1781837076380316 us; error 35 us; skew 500 ppm
I20260619 02:44:36.381500 17796 webserver.cc:460] Webserver started at http://127.12.145.67:34435/ using document root <none> and password file <none>
I20260619 02:44:36.381747 17796 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:36.381811 17796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:36.381953 17796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:36.383020 17796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "18d2f358861848c9a2aa0757c1d83eac"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "a0ae1ff025e4f75ad09dbe2402e41a22"
server_key_iv: "f10c266419f06622800683495531f760"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.383366 17796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "18d2f358861848c9a2aa0757c1d83eac"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "a0ae1ff025e4f75ad09dbe2402e41a22"
server_key_iv: "f10c266419f06622800683495531f760"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.384642 17796 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:36.385324 17810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.385483 17796 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:36.385571 17796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "18d2f358861848c9a2aa0757c1d83eac"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "a0ae1ff025e4f75ad09dbe2402e41a22"
server_key_iv: "f10c266419f06622800683495531f760"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.385648 17796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:36.388870 17796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:36.389114 17796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:36.389271 17796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:36.389456 17796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:36.389768 17796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:36.389818 17796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.389855 17796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:36.389883 17796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.395490 17796 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:45015
I20260619 02:44:36.395532 17923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:45015 every 8 connection(s)
I20260619 02:44:36.395817 17796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:44:36.396378 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17796
I20260619 02:44:36.396471 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:36.396680 12869 external_mini_cluster.cc:1428] Setting key 8a8435da0fcedd70fab7940e28ce3008
I20260619 02:44:36.398658 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.396467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:45317 (local address 127.12.145.126:34811)
0619 02:44:36.396503 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.396506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.396782 (+ 276us) server_negotiation.cc:407] Connection header received
0619 02:44:36.397299 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.397300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.397307 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.397354 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.398392 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.398393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.398393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.398397 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.398411 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.398415 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.398465 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.398577 (+ 112us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.398591 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260619 02:44:36.398849 17926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.396498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34811 (local address 127.12.145.67:45317)
0619 02:44:36.396663 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.396692 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.397191 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.397462 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.397465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.397472 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.398250 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.398250 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.398273 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.398296 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.398475 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.398479 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.398482 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.398604 (+ 122us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.398658 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260619 02:44:36.399307 17924 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34811
I20260619 02:44:36.399372 17924 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:36.399519 17924 heartbeater.cc:511] Master 127.12.145.126:34811 requested a full tablet report, sending...
I20260619 02:44:36.399852 17473 ts_manager.cc:194] Registered new tserver with Master: 18d2f358861848c9a2aa0757c1d83eac (127.12.145.67:45015)
I20260619 02:44:36.408263 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:44:36.410681 17513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.409544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52632 (local address 127.12.145.126:34811)
0619 02:44:36.409632 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.409634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.409684 (+ 50us) server_negotiation.cc:407] Connection header received
0619 02:44:36.409744 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.409744 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.409748 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.409793 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.410409 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.410409 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.410410 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.410412 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.410421 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.410424 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.410462 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.410526 (+ 64us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.410536 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 02:44:36.412266 17473 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52632:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:44:36.413740 17473 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:36.417364 17933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.415746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:33353 (local address 127.0.0.1:56502)
0619 02:44:36.415912 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.415950 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.416004 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.416341 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.416342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.416344 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.416886 (+ 542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.416886 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.416898 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.416913 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.417183 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.417188 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.417191 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.417236 (+ 45us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.417262 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":68,"threads_started":1}
I20260619 02:44:36.417481 17935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.415826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56502 (local address 127.12.145.66:33353)
0619 02:44:36.416201 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.416205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.416213 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:36.416238 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.416240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.416248 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.416490 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.417004 (+ 514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.417012 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.417012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.417016 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.417053 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.417071 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.417335 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.417357 (+ 22us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.417371 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":72,"threads_started":1}
I20260619 02:44:36.417590 17934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.415817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38480 (local address 127.12.145.67:45015)
0619 02:44:36.416111 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.416115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.416124 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:36.416195 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.416199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.416208 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.416279 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.417075 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.417082 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.417082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.417086 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.417117 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.417137 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.417191 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.417397 (+ 206us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.417411 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":69,"threads_started":1}
I20260619 02:44:36.417366 17936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.415751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:45015 (local address 127.0.0.1:38480)
0619 02:44:36.416060 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.416069 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.416125 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.416293 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.416300 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.416307 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.416969 (+ 662us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.416970 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.416976 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.416989 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.417216 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.417217 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.417218 (+ 1us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.417275 (+ 57us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.417287 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":90,"threads_started":1}
I20260619 02:44:36.417815 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.415938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:38729 (local address 127.0.0.1:48532)
0619 02:44:36.416067 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.416078 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.416121 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.416960 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.416961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.416963 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.417479 (+ 516us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.417480 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.417485 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.417497 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.417709 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.417710 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.417711 (+ 1us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.417751 (+ 40us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.417763 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260619 02:44:36.417994 17937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.416035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48532 (local address 127.12.145.65:38729)
0619 02:44:36.416209 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.416213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.416221 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:36.416268 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.416270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.416280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.416348 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.417571 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.417576 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.417577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.417580 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.417612 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.417631 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.417685 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.417890 (+ 205us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.417905 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":77,"threads_started":1}
I20260619 02:44:36.418093 17727 tablet_service.cc:1467] Processing CreateTablet for tablet 1a59d149c21d45c9bcb78f0937fb9e2a (DEFAULT_TABLE table=test-table [id=39987bc382f44107a55af2f9975a2e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:36.418432 17727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a59d149c21d45c9bcb78f0937fb9e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:36.418330 17858 tablet_service.cc:1467] Processing CreateTablet for tablet 1a59d149c21d45c9bcb78f0937fb9e2a (DEFAULT_TABLE table=test-table [id=39987bc382f44107a55af2f9975a2e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:36.418663 17858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a59d149c21d45c9bcb78f0937fb9e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:36.418597 17596 tablet_service.cc:1467] Processing CreateTablet for tablet 1a59d149c21d45c9bcb78f0937fb9e2a (DEFAULT_TABLE table=test-table [id=39987bc382f44107a55af2f9975a2e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:36.418896 17596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a59d149c21d45c9bcb78f0937fb9e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:36.420908 17938 tablet_bootstrap.cc:492] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Bootstrap starting.
I20260619 02:44:36.421541 17938 tablet_bootstrap.cc:654] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:36.421846 17938 log.cc:824] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:36.422150 17940 tablet_bootstrap.cc:492] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a: Bootstrap starting.
I20260619 02:44:36.422242 17939 tablet_bootstrap.cc:492] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Bootstrap starting.
I20260619 02:44:36.422683 17938 tablet_bootstrap.cc:492] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: No bootstrap required, opened a new log
I20260619 02:44:36.422749 17938 ts_tablet_manager.cc:1397] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:36.422801 17940 tablet_bootstrap.cc:654] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:36.422886 17939 tablet_bootstrap.cc:654] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:36.423089 17940 log.cc:824] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:36.423192 17939 log.cc:824] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:36.423836 17939 tablet_bootstrap.cc:492] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: No bootstrap required, opened a new log
I20260619 02:44:36.423903 17939 ts_tablet_manager.cc:1397] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:36.425431 17938 raft_consensus.cc:348] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.425588 17938 raft_consensus.cc:374] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:36.425631 17938 raft_consensus.cc:729] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18d2f358861848c9a2aa0757c1d83eac, State: Initialized, Role: FOLLOWER
I20260619 02:44:36.425751 17938 consensus_queue.cc:260] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.426044 17938 ts_tablet_manager.cc:1428] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:44:36.426174 17924 heartbeater.cc:503] Master 127.12.145.126:34811 was elected leader, sending a full tablet report...
I20260619 02:44:36.426407 17939 raft_consensus.cc:348] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.426596 17939 raft_consensus.cc:374] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:36.426646 17939 raft_consensus.cc:729] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a9f9b9c9394e42bff50ab8f58ab213, State: Initialized, Role: FOLLOWER
I20260619 02:44:36.426749 17939 consensus_queue.cc:260] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.427011 17939 ts_tablet_manager.cc:1428] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260619 02:44:36.427129 17793 heartbeater.cc:503] Master 127.12.145.126:34811 was elected leader, sending a full tablet report...
I20260619 02:44:36.427525 17940 tablet_bootstrap.cc:492] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a: No bootstrap required, opened a new log
I20260619 02:44:36.427590 17940 ts_tablet_manager.cc:1397] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260619 02:44:36.429270 17940 raft_consensus.cc:348] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.429401 17940 raft_consensus.cc:374] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:36.429443 17940 raft_consensus.cc:729] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35677f74a2ca41dead63d38a1b0de28a, State: Initialized, Role: FOLLOWER
I20260619 02:44:36.429545 17940 consensus_queue.cc:260] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.429786 17940 ts_tablet_manager.cc:1428] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:44:36.429804 17662 heartbeater.cc:503] Master 127.12.145.126:34811 was elected leader, sending a full tablet report...
I20260619 02:44:36.439798 17946 raft_consensus.cc:482] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:36.439908 17946 raft_consensus.cc:504] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.440239 17946 leader_election.cc:288] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a9f9b9c9394e42bff50ab8f58ab213 (127.12.145.66:33353), 18d2f358861848c9a2aa0757c1d83eac (127.12.145.67:45015)
I20260619 02:44:36.441416 17664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.440376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:33353 (local address 127.12.145.65:39429)
0619 02:44:36.440459 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.440472 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.440512 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.440682 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.440683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.440685 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.441141 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.441142 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.441149 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.441161 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.441294 (+ 133us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.441295 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.441295 (+ 0us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.441342 (+ 47us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.441355 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260619 02:44:36.441432 17935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.440499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:39429 (local address 127.12.145.66:33353)
0619 02:44:36.440565 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.440567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.440577 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:44:36.440599 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.440600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.440605 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.440668 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.441233 (+ 565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.441234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.441235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.441238 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.441250 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.441254 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.441294 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.441359 (+ 65us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.441373 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:44:36.441675 17934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.440416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:52741 (local address 127.12.145.67:45015)
0619 02:44:36.440546 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.440548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.440711 (+ 163us) server_negotiation.cc:407] Connection header received
0619 02:44:36.440736 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.440737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.440741 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.440851 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.441421 (+ 570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.441422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.441423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.441427 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.441447 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.441451 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.441504 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.441602 (+ 98us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.441614 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260619 02:44:36.441710 17747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a59d149c21d45c9bcb78f0937fb9e2a" candidate_uuid: "35677f74a2ca41dead63d38a1b0de28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" is_pre_election: true
I20260619 02:44:36.441850 17947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.440376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:45015 (local address 127.12.145.65:52741)
0619 02:44:36.440619 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.440631 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.440694 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.440866 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.440867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.440869 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:36.441339 (+ 470us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:44:36.441340 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:36.441344 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:44:36.441353 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:36.441531 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:36.441532 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:36.441533 (+ 1us) client_negotiation.cc:769] Sending connection context
0619 02:44:36.441757 (+ 224us) client_negotiation.cc:240] Negotiation successful
0619 02:44:36.441773 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":10,"thread_start_us":169,"threads_started":1}
I20260619 02:44:36.441854 17747 raft_consensus.cc:2454] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35677f74a2ca41dead63d38a1b0de28a in term 0.
I20260619 02:44:36.442065 17552 leader_election.cc:302] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35677f74a2ca41dead63d38a1b0de28a, 87a9f9b9c9394e42bff50ab8f58ab213; no voters:
I20260619 02:44:36.442144 17878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a59d149c21d45c9bcb78f0937fb9e2a" candidate_uuid: "35677f74a2ca41dead63d38a1b0de28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18d2f358861848c9a2aa0757c1d83eac" is_pre_election: true
I20260619 02:44:36.442194 17946 raft_consensus.cc:2781] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:36.442243 17946 raft_consensus.cc:482] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:36.442273 17946 raft_consensus.cc:3037] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:36.442260 17878 raft_consensus.cc:2454] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35677f74a2ca41dead63d38a1b0de28a in term 0.
I20260619 02:44:36.442999 17946 raft_consensus.cc:504] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.443131 17946 leader_election.cc:288] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [CANDIDATE]: Term 1 election: Requested vote from peers 87a9f9b9c9394e42bff50ab8f58ab213 (127.12.145.66:33353), 18d2f358861848c9a2aa0757c1d83eac (127.12.145.67:45015)
I20260619 02:44:36.443264 17747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a59d149c21d45c9bcb78f0937fb9e2a" candidate_uuid: "35677f74a2ca41dead63d38a1b0de28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a9f9b9c9394e42bff50ab8f58ab213"
I20260619 02:44:36.443316 17878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a59d149c21d45c9bcb78f0937fb9e2a" candidate_uuid: "35677f74a2ca41dead63d38a1b0de28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18d2f358861848c9a2aa0757c1d83eac"
I20260619 02:44:36.443331 17747 raft_consensus.cc:3037] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:36.443379 17878 raft_consensus.cc:3037] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:36.444124 17747 raft_consensus.cc:2454] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35677f74a2ca41dead63d38a1b0de28a in term 1.
I20260619 02:44:36.444118 17878 raft_consensus.cc:2454] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35677f74a2ca41dead63d38a1b0de28a in term 1.
I20260619 02:44:36.444257 17552 leader_election.cc:302] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35677f74a2ca41dead63d38a1b0de28a, 87a9f9b9c9394e42bff50ab8f58ab213; no voters:
I20260619 02:44:36.444345 17946 raft_consensus.cc:2781] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:36.444478 17946 raft_consensus.cc:686] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 1 LEADER]: Becoming Leader. State: Replica: 35677f74a2ca41dead63d38a1b0de28a, State: Running, Role: LEADER
I20260619 02:44:36.444556 17946 consensus_queue.cc:237] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } }
I20260619 02:44:36.445243 17473 catalog_manager.cc:5495] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a reported cstate change: term changed from 0 to 1, leader changed from <none> to 35677f74a2ca41dead63d38a1b0de28a (127.12.145.65). New cstate: current_term: 1 leader_uuid: "35677f74a2ca41dead63d38a1b0de28a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35677f74a2ca41dead63d38a1b0de28a" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260619 02:44:36.448791 17937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.448010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48542 (local address 127.12.145.65:38729)
0619 02:44:36.448044 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.448046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.448104 (+ 58us) server_negotiation.cc:407] Connection header received
0619 02:44:36.448143 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.448144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.448152 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.448198 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.448652 (+ 454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.448652 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.448653 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.448656 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.448667 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.448670 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.448713 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.448741 (+ 28us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.448751 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:44:36.450274 17747 raft_consensus.cc:1261] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 1 FOLLOWER]: Refusing update from remote peer 35677f74a2ca41dead63d38a1b0de28a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:36.450274 17878 raft_consensus.cc:1261] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 1 FOLLOWER]: Refusing update from remote peer 35677f74a2ca41dead63d38a1b0de28a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:36.450666 17948 consensus_queue.cc:1035] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [LEADER]: Connected to new peer: Peer: permanent_uuid: "18d2f358861848c9a2aa0757c1d83eac" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 45015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:36.450798 17946 consensus_queue.cc:1035] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a9f9b9c9394e42bff50ab8f58ab213" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 33353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:36.453398 17952 mvcc.cc:205] Tried to move back new op lower bound from 7298404665137868800 to 7298404665117499392. Current Snapshot: MvccSnapshot[applied={T|T < 7298404665137868800 or (T in {7298404665137868800})}]
I20260619 02:44:36.453502 17953 mvcc.cc:205] Tried to move back new op lower bound from 7298404665137868800 to 7298404665117499392. Current Snapshot: MvccSnapshot[applied={T|T < 7298404665137868800 or (T in {7298404665137868800})}]
I20260619 02:44:36.453625 17951 mvcc.cc:205] Tried to move back new op lower bound from 7298404665137868800 to 7298404665117499392. Current Snapshot: MvccSnapshot[applied={T|T < 7298404665137868800}]
I20260619 02:44:36.455539 17474 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:36.455636 17474 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52632:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:36.456270 17474 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d5f914320dc4063ac4aa4fb0997ec16: Sending DeleteTablet for 3 replicas of tablet 1a59d149c21d45c9bcb78f0937fb9e2a
I20260619 02:44:36.456601 17858 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a59d149c21d45c9bcb78f0937fb9e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:36 UTC) from {username='slave'} at 127.0.0.1:38480
I20260619 02:44:36.456662 17596 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a59d149c21d45c9bcb78f0937fb9e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:36 UTC) from {username='slave'} at 127.0.0.1:48532
I20260619 02:44:36.456693 17727 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a59d149c21d45c9bcb78f0937fb9e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:36 UTC) from {username='slave'} at 127.0.0.1:56502
I20260619 02:44:36.456835 17961 tablet_replica.cc:330] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: stopping tablet replica
I20260619 02:44:36.456928 17961 raft_consensus.cc:2229] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:36.457024 17961 raft_consensus.cc:2258] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:36.457096 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17534
I20260619 02:44:36.457165 17962 tablet_replica.cc:330] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a: stopping tablet replica
I20260619 02:44:36.457258 17962 raft_consensus.cc:2229] T 1a59d149c21d45c9bcb78f0937fb9e2a P 35677f74a2ca41dead63d38a1b0de28a [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:36.458474 17963 tablet_replica.cc:330] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: stopping tablet replica
I20260619 02:44:36.458598 17963 raft_consensus.cc:2229] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:36.458719 17963 raft_consensus.cc:2258] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:36.459195 17963 ts_tablet_manager.cc:1905] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:36.461076 17963 ts_tablet_manager.cc:1918] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:36.461151 17963 log.cc:1196] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/1a59d149c21d45c9bcb78f0937fb9e2a
I20260619 02:44:36.461390 17963 ts_tablet_manager.cc:1939] T 1a59d149c21d45c9bcb78f0937fb9e2a P 87a9f9b9c9394e42bff50ab8f58ab213: Deleting consensus metadata
I20260619 02:44:36.461905 17461 catalog_manager.cc:4841] TS 87a9f9b9c9394e42bff50ab8f58ab213 (127.12.145.66:33353): tablet 1a59d149c21d45c9bcb78f0937fb9e2a (table test-table [id=39987bc382f44107a55af2f9975a2e2d]) successfully deleted
W20260619 02:44:36.462850 17461 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:38729 (error 108)
I20260619 02:44:36.463006 17961 ts_tablet_manager.cc:1905] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:36.463032 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17665
I20260619 02:44:36.464515 17961 ts_tablet_manager.cc:1918] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:36.464608 17961 log.cc:1196] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/1a59d149c21d45c9bcb78f0937fb9e2a
I20260619 02:44:36.464820 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.464697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:38729 (local address 127.0.0.1:48548)
0619 02:44:36.464741 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.464781 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:38729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260619 02:44:36.464872 17961 ts_tablet_manager.cc:1939] T 1a59d149c21d45c9bcb78f0937fb9e2a P 18d2f358861848c9a2aa0757c1d83eac: Deleting consensus metadata
W20260619 02:44:36.464928 17461 catalog_manager.cc:4584] TS 35677f74a2ca41dead63d38a1b0de28a (127.12.145.65:38729): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a59d149c21d45c9bcb78f0937fb9e2a: Network error: Client connection negotiation failed: client connection to 127.12.145.65:38729: connect: Connection refused (error 111)
I20260619 02:44:36.465288 17458 catalog_manager.cc:4841] TS 18d2f358861848c9a2aa0757c1d83eac (127.12.145.67:45015): tablet 1a59d149c21d45c9bcb78f0937fb9e2a (table test-table [id=39987bc382f44107a55af2f9975a2e2d]) successfully deleted
I20260619 02:44:36.468034 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17796
I20260619 02:44:36.472271 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17443
2026-06-19T02:44:36Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (570 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260619 02:44:36.491335 12869 mini_oidc.cc:152] Starting JWKS server
I20260619 02:44:36.492386 12869 webserver.cc:460] Webserver started at https://127.0.0.1:39003/ using document root <none> and password file <none>
I20260619 02:44:36.492515 12869 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 02:44:36.492690 12869 webserver.cc:460] Webserver started at http://127.0.0.1:37549/ using document root <none> and password file <none>
2026-06-19T02:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:36Z Disabled control of system clock
I20260619 02:44:36.500239 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34331
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:40179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34331
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39003/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/testchainca.cert with env {}
W20260619 02:44:36.581128 17970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:36.581322 17970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:36.581343 17970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:36.582460 17970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:36.582496 17970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:36.582508 17970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:36.582521 17970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:36.582533 17970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 02:44:36.582600 17970 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 02:44:36.582626 17970 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39003/jwks.json
I20260619 02:44:36.584270 17970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34331
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39003/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:36.584465 17970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:36.584619 17970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:36.589195 17978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.589190 17976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.589190 17975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.589421 17970 server_base.cc:1034] running on GCE node
I20260619 02:44:36.589717 17970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:36.590008 17970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:36.591171 17970 hybrid_clock.cc:648] HybridClock initialized: now 1781837076591158 us; error 42 us; skew 500 ppm
I20260619 02:44:36.592357 17970 webserver.cc:460] Webserver started at http://127.12.145.126:41877/ using document root <none> and password file <none>
I20260619 02:44:36.592589 17970 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:36.592656 17970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:36.592803 17970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:36.593868 17970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "40f65b6cd5bf4525a9d16470ba91755c"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "1e85969ee288df6f84e0bfff5e9f8d8f"
server_key_iv: "32777bae0bcaaf8767b3a88b24efb3da"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.594216 17970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "40f65b6cd5bf4525a9d16470ba91755c"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "1e85969ee288df6f84e0bfff5e9f8d8f"
server_key_iv: "32777bae0bcaaf8767b3a88b24efb3da"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.595523 17970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:36.596220 17984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.596386 17970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:36.596488 17970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "40f65b6cd5bf4525a9d16470ba91755c"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "1e85969ee288df6f84e0bfff5e9f8d8f"
server_key_iv: "32777bae0bcaaf8767b3a88b24efb3da"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.596560 17970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:36.631994 17970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:36.632330 17970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:36.632483 17970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:36.636632 17970 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:34331
I20260619 02:44:36.636670 18036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:34331 every 8 connection(s)
I20260619 02:44:36.637017 17970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:36.637960 18037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:36.640218 18037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c: Bootstrap starting.
I20260619 02:44:36.640794 18037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:36.641088 18037 log.cc:824] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:36.641739 18037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c: No bootstrap required, opened a new log
I20260619 02:44:36.643409 18037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f65b6cd5bf4525a9d16470ba91755c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34331 } }
I20260619 02:44:36.643540 18037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:36.643561 18037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f65b6cd5bf4525a9d16470ba91755c, State: Initialized, Role: FOLLOWER
I20260619 02:44:36.643728 18037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f65b6cd5bf4525a9d16470ba91755c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34331 } }
I20260619 02:44:36.643806 18037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:36.643854 18037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:36.643903 18037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:36.644394 18037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f65b6cd5bf4525a9d16470ba91755c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34331 } }
I20260619 02:44:36.644496 18037 leader_election.cc:302] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40f65b6cd5bf4525a9d16470ba91755c; no voters:
I20260619 02:44:36.644709 18037 leader_election.cc:288] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:36.644750 18040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:36.644737 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 17970
I20260619 02:44:36.644837 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:36.644873 18040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [term 1 LEADER]: Becoming Leader. State: Replica: 40f65b6cd5bf4525a9d16470ba91755c, State: Running, Role: LEADER
I20260619 02:44:36.644963 18037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:36.644968 18040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f65b6cd5bf4525a9d16470ba91755c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34331 } }
I20260619 02:44:36.645051 12869 external_mini_cluster.cc:1428] Setting key 34afbcb4c8a2f545aeca95d574b5a7a5
I20260619 02:44:36.645290 18040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40f65b6cd5bf4525a9d16470ba91755c. Latest consensus state: current_term: 1 leader_uuid: "40f65b6cd5bf4525a9d16470ba91755c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f65b6cd5bf4525a9d16470ba91755c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34331 } } }
I20260619 02:44:36.645362 18040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:36.645500 18042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40f65b6cd5bf4525a9d16470ba91755c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40f65b6cd5bf4525a9d16470ba91755c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34331 } } }
I20260619 02:44:36.645639 18042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:36.645821 18045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:36.646409 18045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:36.648049 18045 catalog_manager.cc:1347] Generated new cluster ID: 30683ccc784c4ee18ab491159c50f52e
I20260619 02:44:36.648104 18045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:36.651885 18051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.645667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49304 (local address 127.12.145.126:34331)
0619 02:44:36.645878 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.645888 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.646132 (+ 244us) server_negotiation.cc:407] Connection header received
0619 02:44:36.646251 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.646258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.646336 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.646469 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.646891 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.648242 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.649418 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.650032 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.650156 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:36.651039 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.651042 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.651043 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.651274 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.651313 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.651328 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.651387 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.651597 (+ 210us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.651675 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260619 02:44:36.652824 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:44:36.662027 18045 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:36.662743 18045 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:36.671572 18045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40f65b6cd5bf4525a9d16470ba91755c: Generated new TSK 0
I20260619 02:44:36.671779 18045 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260619 02:44:36.701452 18067 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260619 02:44:36.701658 18067 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260619 02:44:36.702225 18066 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:36.686013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34331 (local address 127.0.0.1:49308)
0619 02:44:36.686203 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.686213 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.686284 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.686624 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.686628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.686639 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0619 02:44:36.686698 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:36.686700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.687629 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.687630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:36.688199 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:36.688200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.688684 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.688685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:36.688728 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:36.688745 (+ 17us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 02:44:36.701785 (+ 13040us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0619 02:44:36.701887 (+ 102us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.126:34331: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":104,"threads_started":1}
I20260619 02:44:36.702684 18051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.686056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49308 (local address 127.12.145.126:34331)
0619 02:44:36.686102 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.686104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.686286 (+ 182us) server_negotiation.cc:407] Connection header received
0619 02:44:36.686372 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.686373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.686386 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.686462 (+ 76us) server_negotiation.cc:226] Negotiated authn=JWT
0619 02:44:36.686775 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.687550 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.688272 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.688611 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.688681 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:36.688842 (+ 161us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 02:44:36.701629 (+ 12787us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0619 02:44:36.702479 (+ 850us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49308: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":25}
W20260619 02:44:36.702739 18051 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49308: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.145.126:34331: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39003/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260619 02:44:36.702814 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 17970
2026-06-19T02:44:36Z chronyd exiting
I20260619 02:44:36.738657 12869 test_util.cc:175] -----------------------------------------------
I20260619 02:44:36.738734 12869 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781837054956172-12869-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (248 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260619 02:44:36.739506 12869 mini_oidc.cc:152] Starting JWKS server
I20260619 02:44:36.740212 12869 webserver.cc:460] Webserver started at https://127.0.0.1:37957/ using document root <none> and password file <none>
I20260619 02:44:36.740252 12869 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 02:44:36.740453 12869 webserver.cc:460] Webserver started at http://127.0.0.1:38403/ using document root <none> and password file <none>
2026-06-19T02:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:36Z Disabled control of system clock
I20260619 02:44:36.747925 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:41667
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:41427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:41667
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37957/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/testchainca.cert with env {}
W20260619 02:44:36.826891 18073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:36.827121 18073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:36.827160 18073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:36.828290 18073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:36.828354 18073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:36.828377 18073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:36.828397 18073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:36.828425 18073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 02:44:36.828450 18073 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 02:44:36.828476 18073 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37957/jwks.json
I20260619 02:44:36.829931 18073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:41427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:41667
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:41667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37957/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:36.830188 18073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:36.830400 18073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:36.835098 18081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.835117 18079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:36.835105 18078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:36.835420 18073 server_base.cc:1034] running on GCE node
I20260619 02:44:36.835664 18073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:36.835937 18073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:36.837097 18073 hybrid_clock.cc:648] HybridClock initialized: now 1781837076837094 us; error 36 us; skew 500 ppm
I20260619 02:44:36.838300 18073 webserver.cc:460] Webserver started at http://127.12.145.126:40895/ using document root <none> and password file <none>
I20260619 02:44:36.838591 18073 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:36.838660 18073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:36.838804 18073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:36.839802 18073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "7f7f94857ac24b0b8c5cfb47b537db67"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "bec15583dfa7106fd55ad796e3492cc9"
server_key_iv: "bb1bd3e782a34cfe543ff2d65f31964e"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.840199 18073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "7f7f94857ac24b0b8c5cfb47b537db67"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "bec15583dfa7106fd55ad796e3492cc9"
server_key_iv: "bb1bd3e782a34cfe543ff2d65f31964e"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.841573 18073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:36.842340 18087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:36.842583 18073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:36.842680 18073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "7f7f94857ac24b0b8c5cfb47b537db67"
format_stamp: "Formatted at 2026-06-19 02:44:36 on dist-test-slave-fbl4"
server_key: "bec15583dfa7106fd55ad796e3492cc9"
server_key_iv: "bb1bd3e782a34cfe543ff2d65f31964e"
server_key_version: "encryptionkey@0"
I20260619 02:44:36.842760 18073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:36.859403 18073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:36.859688 18073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:36.859834 18073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:36.864799 18073 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:41667
I20260619 02:44:36.864820 18139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:41667 every 8 connection(s)
I20260619 02:44:36.865216 18073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:36.865846 18140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:36.868386 18140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67: Bootstrap starting.
I20260619 02:44:36.868878 18140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:36.869114 18140 log.cc:824] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:36.869663 18140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67: No bootstrap required, opened a new log
I20260619 02:44:36.871246 18140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41667 } }
I20260619 02:44:36.871376 18140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:36.871397 18140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f7f94857ac24b0b8c5cfb47b537db67, State: Initialized, Role: FOLLOWER
I20260619 02:44:36.871536 18140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41667 } }
I20260619 02:44:36.871609 18140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:36.871631 18140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:36.871658 18140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:36.872192 18140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41667 } }
I20260619 02:44:36.872223 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18073
I20260619 02:44:36.872270 18140 leader_election.cc:302] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f7f94857ac24b0b8c5cfb47b537db67; no voters:
I20260619 02:44:36.872328 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:36.872468 18140 leader_election.cc:288] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:36.872538 12869 external_mini_cluster.cc:1428] Setting key 94eb7fa9f58d3a45ff70fdbcc96306e3
I20260619 02:44:36.872546 18143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:36.872709 18140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:36.873123 18143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [term 1 LEADER]: Becoming Leader. State: Replica: 7f7f94857ac24b0b8c5cfb47b537db67, State: Running, Role: LEADER
I20260619 02:44:36.873221 18143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41667 } }
I20260619 02:44:36.873579 18147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f7f94857ac24b0b8c5cfb47b537db67. Latest consensus state: current_term: 1 leader_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41667 } } }
I20260619 02:44:36.873660 18147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:36.873739 18144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f7f94857ac24b0b8c5cfb47b537db67" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41667 } } }
I20260619 02:44:36.873831 18144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:36.873857 18154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:36.874344 18154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:36.875921 18154 catalog_manager.cc:1347] Generated new cluster ID: 16704abfba634c25bee84cf2e01dd408
I20260619 02:44:36.875975 18154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:36.878538 18146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.872995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52834 (local address 127.12.145.126:41667)
0619 02:44:36.873249 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.873257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.873368 (+ 111us) server_negotiation.cc:407] Connection header received
0619 02:44:36.873494 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.873501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.873743 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.874003 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:36.874335 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.875782 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.876642 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.877095 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.877237 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:36.877897 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:36.877901 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:36.877901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:36.878080 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:36.878110 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:36.878121 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:36.878203 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:36.878285 (+ 82us) server_negotiation.cc:299] Negotiation successful
0619 02:44:36.878359 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260619 02:44:36.883368 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:44:36.895850 18154 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:36.896320 18154 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:36.899183 18154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f7f94857ac24b0b8c5cfb47b537db67: Generated new TSK 0
I20260619 02:44:36.899349 18154 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260619 02:44:36.918221 18170 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260619 02:44:36.918320 18170 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260619 02:44:36.918678 18146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:36.904213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52844 (local address 127.12.145.126:41667)
0619 02:44:36.904262 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:36.904264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:36.904309 (+ 45us) server_negotiation.cc:407] Connection header received
0619 02:44:36.904367 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:36.904368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:36.904380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:36.904449 (+ 69us) server_negotiation.cc:226] Negotiated authn=JWT
0619 02:44:36.904572 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.905370 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.906130 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.906451 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.906524 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:36.906786 (+ 262us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 02:44:36.918422 (+ 11636us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0619 02:44:36.918598 (+ 176us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52844: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":25}
W20260619 02:44:36.918735 18146 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52844: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260619 02:44:36.918895 18169 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:36.904123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:41667 (local address 127.0.0.1:52844)
0619 02:44:36.904252 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:36.904268 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:36.904319 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:36.904458 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:36.904459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:36.904460 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0619 02:44:36.904506 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:36.904507 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.905454 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.905455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:36.906042 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:36.906044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:36.906618 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:36.906620 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:36.906681 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:36.906685 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 02:44:36.918602 (+ 11917us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0619 02:44:36.918746 (+ 144us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.126:41667: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":72,"threads_started":1}
I20260619 02:44:36.919073 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18073
2026-06-19T02:44:36Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (216 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260619 02:44:36.956427 12869 mini_oidc.cc:152] Starting JWKS server
I20260619 02:44:36.957118 12869 webserver.cc:460] Webserver started at https://127.0.0.1:38825/ using document root <none> and password file <none>
I20260619 02:44:36.957159 12869 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 02:44:36.957340 12869 webserver.cc:460] Webserver started at http://127.0.0.1:37993/ using document root <none> and password file <none>
2026-06-19T02:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:36Z Disabled control of system clock
I20260619 02:44:36.964654 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34927
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34927
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38825/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260619 02:44:37.043125 18176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:37.043309 18176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:37.043330 18176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:37.044384 18176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:37.044418 18176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:37.044431 18176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:37.044443 18176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:37.044456 18176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 02:44:37.044467 18176 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 02:44:37.044478 18176 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38825/jwks.json
I20260619 02:44:37.045727 18176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34927
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38825/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:37.045902 18176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:37.046137 18176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:37.050983 18181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:37.051064 18176 server_base.cc:1034] running on GCE node
W20260619 02:44:37.050989 18184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:37.051002 18182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:37.051411 18176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:37.051669 18176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:37.052825 18176 hybrid_clock.cc:648] HybridClock initialized: now 1781837077052813 us; error 29 us; skew 500 ppm
I20260619 02:44:37.053928 18176 webserver.cc:460] Webserver started at http://127.12.145.126:41395/ using document root <none> and password file <none>
I20260619 02:44:37.054133 18176 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:37.054172 18176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:37.054257 18176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:37.055320 18176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "f71aa3c958da4781bcc85926045d938d"
format_stamp: "Formatted at 2026-06-19 02:44:37 on dist-test-slave-fbl4"
server_key: "701ad96f9966ee1c4bedd2b7a741eafe"
server_key_iv: "1cf36a99c76a93d1bdfdbc854caa675b"
server_key_version: "encryptionkey@0"
I20260619 02:44:37.055608 18176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "f71aa3c958da4781bcc85926045d938d"
format_stamp: "Formatted at 2026-06-19 02:44:37 on dist-test-slave-fbl4"
server_key: "701ad96f9966ee1c4bedd2b7a741eafe"
server_key_iv: "1cf36a99c76a93d1bdfdbc854caa675b"
server_key_version: "encryptionkey@0"
I20260619 02:44:37.056805 18176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:44:37.057466 18190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:37.057664 18176 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:37.057747 18176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "f71aa3c958da4781bcc85926045d938d"
format_stamp: "Formatted at 2026-06-19 02:44:37 on dist-test-slave-fbl4"
server_key: "701ad96f9966ee1c4bedd2b7a741eafe"
server_key_iv: "1cf36a99c76a93d1bdfdbc854caa675b"
server_key_version: "encryptionkey@0"
I20260619 02:44:37.057798 18176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:37.069788 18176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:37.070031 18176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:37.070137 18176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:37.073664 18176 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:34927
I20260619 02:44:37.073715 18242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:34927 every 8 connection(s)
I20260619 02:44:37.074028 18176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:37.074730 18243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:37.077354 18243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d: Bootstrap starting.
I20260619 02:44:37.077957 18243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:37.078239 18243 log.cc:824] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:37.078655 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18176
I20260619 02:44:37.078768 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:37.078984 12869 external_mini_cluster.cc:1428] Setting key 5a30f345b34cc43661c7f89d8d6bc0d4
I20260619 02:44:37.079095 18243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d: No bootstrap required, opened a new log
I20260619 02:44:37.081804 18243 raft_consensus.cc:348] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71aa3c958da4781bcc85926045d938d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34927 } }
I20260619 02:44:37.081956 18243 raft_consensus.cc:374] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:37.081984 18243 raft_consensus.cc:729] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f71aa3c958da4781bcc85926045d938d, State: Initialized, Role: FOLLOWER
I20260619 02:44:37.082099 18243 consensus_queue.cc:260] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71aa3c958da4781bcc85926045d938d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34927 } }
I20260619 02:44:37.082168 18243 raft_consensus.cc:388] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:37.082204 18243 raft_consensus.cc:482] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:37.082257 18243 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:37.082850 18243 raft_consensus.cc:504] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71aa3c958da4781bcc85926045d938d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34927 } }
I20260619 02:44:37.082934 18243 leader_election.cc:302] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f71aa3c958da4781bcc85926045d938d; no voters:
I20260619 02:44:37.083133 18243 leader_election.cc:288] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:37.083153 18248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:37.083263 18248 raft_consensus.cc:686] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [term 1 LEADER]: Becoming Leader. State: Replica: f71aa3c958da4781bcc85926045d938d, State: Running, Role: LEADER
I20260619 02:44:37.083343 18248 consensus_queue.cc:237] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71aa3c958da4781bcc85926045d938d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34927 } }
I20260619 02:44:37.083391 18243 sys_catalog.cc:564] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:37.083650 18249 sys_catalog.cc:455] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f71aa3c958da4781bcc85926045d938d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71aa3c958da4781bcc85926045d938d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34927 } } }
I20260619 02:44:37.083802 18249 sys_catalog.cc:458] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:37.083667 18250 sys_catalog.cc:455] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f71aa3c958da4781bcc85926045d938d. Latest consensus state: current_term: 1 leader_uuid: "f71aa3c958da4781bcc85926045d938d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f71aa3c958da4781bcc85926045d938d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34927 } } }
I20260619 02:44:37.084112 18250 sys_catalog.cc:458] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:37.084100 18256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:37.084717 18256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:37.085541 18247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:37.079473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50934 (local address 127.12.145.126:34927)
0619 02:44:37.079717 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:37.079726 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:37.079772 (+ 46us) server_negotiation.cc:407] Connection header received
0619 02:44:37.080417 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:37.080427 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:37.080498 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:37.080651 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:37.080796 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.082154 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.083100 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.083687 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.083851 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:37.084648 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:37.084654 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:37.084654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:37.084857 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:37.084901 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:37.084916 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:37.085202 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:37.085234 (+ 32us) server_negotiation.cc:299] Negotiation successful
0619 02:44:37.085327 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260619 02:44:37.086455 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:44:37.091027 18256 catalog_manager.cc:1347] Generated new cluster ID: 32300c46cbb544bfb428e1c5cf065001
I20260619 02:44:37.091099 18256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:37.104720 18256 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:37.105222 18256 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:37.113390 18256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f71aa3c958da4781bcc85926045d938d: Generated new TSK 0
I20260619 02:44:37.113612 18256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:44:37.127701 18247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:37.123459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.12.145.126:34927)
0619 02:44:37.123522 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:37.123525 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:37.123628 (+ 103us) server_negotiation.cc:407] Connection header received
0619 02:44:37.123696 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:37.123697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:37.123710 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:37.123787 (+ 77us) server_negotiation.cc:226] Negotiated authn=JWT
0619 02:44:37.123884 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.124661 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.125424 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.125745 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.125816 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:37.125967 (+ 151us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 02:44:37.127337 (+ 1370us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0619 02:44:37.127622 (+ 285us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50936: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":38}
W20260619 02:44:37.127760 18247 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50936: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260619 02:44:37.129469 18272 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:37.123417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34927 (local address 127.0.0.1:50936)
0619 02:44:37.123557 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:37.123567 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:37.123627 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:37.123784 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:37.123784 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:37.123786 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0619 02:44:37.123833 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:37.123835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.124762 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.124763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:37.125343 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:37.125345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.125822 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.125822 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:37.125863 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:37.125867 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 02:44:37.127454 (+ 1587us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0619 02:44:37.129364 (+ 1910us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.126:34927: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":1735,"thread_start_us":95,"threads_started":1}
I20260619 02:44:37.129705 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18176
E20260619 02:44:37.139086 18273 webserver.cc:533] Webserver: sslize failed:
E20260619 02:44:37.139145 18273 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-06-19T02:44:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (210 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-06-19T02:44:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:37Z Disabled control of system clock
I20260619 02:44:37.173985 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36457
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:36457
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/testchainca.cert with env {}
W20260619 02:44:37.253208 18277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:37.253407 18277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:37.253427 18277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:37.254531 18277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:37.254595 18277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:37.254611 18277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:37.254622 18277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:37.254634 18277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 02:44:37.254647 18277 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 02:44:37.254657 18277 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260619 02:44:37.256031 18277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:36457
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:37.256217 18277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:37.256368 18277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:37.260985 18285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:37.261004 18282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:37.260975 18283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:37.261264 18277 server_base.cc:1034] running on GCE node
I20260619 02:44:37.261513 18277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:37.261792 18277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:37.262938 18277 hybrid_clock.cc:648] HybridClock initialized: now 1781837077262930 us; error 37 us; skew 500 ppm
I20260619 02:44:37.264200 18277 webserver.cc:460] Webserver started at http://127.12.145.126:42747/ using document root <none> and password file <none>
I20260619 02:44:37.264478 18277 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:37.264554 18277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:37.264699 18277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:37.265761 18277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "ec30881ae8324e6e8f8108f2b10b7d76"
format_stamp: "Formatted at 2026-06-19 02:44:37 on dist-test-slave-fbl4"
server_key: "8e0a3819e56ef0e36be08d49ee12c0a1"
server_key_iv: "9327849fcbfb93cdd9079e2a54cea3a0"
server_key_version: "encryptionkey@0"
I20260619 02:44:37.266119 18277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "ec30881ae8324e6e8f8108f2b10b7d76"
format_stamp: "Formatted at 2026-06-19 02:44:37 on dist-test-slave-fbl4"
server_key: "8e0a3819e56ef0e36be08d49ee12c0a1"
server_key_iv: "9327849fcbfb93cdd9079e2a54cea3a0"
server_key_version: "encryptionkey@0"
I20260619 02:44:37.267478 18277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:37.268189 18291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:37.268354 18277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:37.268461 18277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "ec30881ae8324e6e8f8108f2b10b7d76"
format_stamp: "Formatted at 2026-06-19 02:44:37 on dist-test-slave-fbl4"
server_key: "8e0a3819e56ef0e36be08d49ee12c0a1"
server_key_iv: "9327849fcbfb93cdd9079e2a54cea3a0"
server_key_version: "encryptionkey@0"
I20260619 02:44:37.268532 18277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:37.288141 18277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:37.288462 18277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:37.288637 18277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:37.292515 18277 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:36457
I20260619 02:44:37.292549 18343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:36457 every 8 connection(s)
I20260619 02:44:37.292917 18277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:37.293830 18344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:37.296149 18344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76: Bootstrap starting.
I20260619 02:44:37.296711 18344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:37.297003 18344 log.cc:824] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:37.297645 18344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76: No bootstrap required, opened a new log
I20260619 02:44:37.297895 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18277
I20260619 02:44:37.298018 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:37.298207 12869 external_mini_cluster.cc:1428] Setting key a4201233cf44dac941caa763c438ea8b
I20260619 02:44:37.299903 18344 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36457 } }
I20260619 02:44:37.300076 18344 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:37.300112 18344 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec30881ae8324e6e8f8108f2b10b7d76, State: Initialized, Role: FOLLOWER
I20260619 02:44:37.300257 18344 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36457 } }
I20260619 02:44:37.300370 18344 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:37.300401 18344 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:37.300446 18344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:37.301131 18344 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36457 } }
I20260619 02:44:37.301249 18344 leader_election.cc:302] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec30881ae8324e6e8f8108f2b10b7d76; no voters:
I20260619 02:44:37.301384 18344 leader_election.cc:288] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:37.301441 18349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:37.301600 18344 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:37.301611 18349 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [term 1 LEADER]: Becoming Leader. State: Replica: ec30881ae8324e6e8f8108f2b10b7d76, State: Running, Role: LEADER
I20260619 02:44:37.301715 18349 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36457 } }
I20260619 02:44:37.302047 18350 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36457 } } }
I20260619 02:44:37.302150 18350 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:37.302047 18351 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec30881ae8324e6e8f8108f2b10b7d76. Latest consensus state: current_term: 1 leader_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec30881ae8324e6e8f8108f2b10b7d76" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36457 } } }
I20260619 02:44:37.302349 18351 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:37.302763 18357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:37.303369 18357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:37.305505 18348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:37.298750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56610 (local address 127.12.145.126:36457)
0619 02:44:37.298971 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:37.298980 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:37.299014 (+ 34us) server_negotiation.cc:407] Connection header received
0619 02:44:37.299866 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:37.299875 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:37.299950 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:37.300100 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:37.300399 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.302174 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.303383 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.303973 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.304132 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:37.304811 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:37.304815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:37.304815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:44:37.305016 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:37.305048 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:44:37.305059 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:37.305135 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:37.305210 (+ 75us) server_negotiation.cc:299] Negotiation successful
0619 02:44:37.305288 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":87,"threads_started":1}
I20260619 02:44:37.305641 18357 catalog_manager.cc:1347] Generated new cluster ID: 67d2cc82d12345608dc64a8846ae613b
I20260619 02:44:37.305682 18357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:37.306381 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:44:37.344766 18357 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:37.345312 18357 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:37.349687 18357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec30881ae8324e6e8f8108f2b10b7d76: Generated new TSK 0
I20260619 02:44:37.349890 18357 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:44:37.856050 18348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:37.361647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56620 (local address 127.12.145.126:36457)
0619 02:44:37.361707 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:37.361709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:37.361836 (+ 127us) server_negotiation.cc:407] Connection header received
0619 02:44:37.361915 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:37.361916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:37.361930 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:37.362031 (+ 101us) server_negotiation.cc:226] Negotiated authn=JWT
0619 02:44:37.362166 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.362689 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.363526 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.363721 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.363805 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:37.364004 (+ 199us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 02:44:37.855752 (+491748us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0619 02:44:37.855957 (+ 205us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56620: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":35}
W20260619 02:44:37.856134 18348 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56620: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260619 02:44:37.856146 18373 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:37.361600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36457 (local address 127.0.0.1:56620)
0619 02:44:37.361758 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:37.361769 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:37.361853 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:37.362033 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:37.362034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:37.362036 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0619 02:44:37.362092 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:37.362094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.362781 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.362782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:37.363378 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:37.363380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:37.363808 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:37.363808 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:37.363876 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:37.363881 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 02:44:37.855913 (+492032us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0619 02:44:37.856038 (+ 125us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.145.126:36457: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260619 02:44:37.856477 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18277
2026-06-19T02:44:37Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (706 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (86 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (85 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:38 dist-test-slave-fbl4 krb5kdc[18385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:38 dist-test-slave-fbl4 krb5kdc[18385](info): set up 2 sockets
Jun 19 02:44:38 dist-test-slave-fbl4 krb5kdc[18385](info): commencing operation
krb5kdc: starting...
W20260619 02:44:39.054948 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:44:39.166767 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:41705
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:42547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:41705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:39.244257 18398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:39.244484 18398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:39.244520 18398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:39.245702 18398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:39.245751 18398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:39.245765 18398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:39.245777 18398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:39.245790 18398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:39.247129 18398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:42547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:41705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:41705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:39.247295 18398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:39.247447 18398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:39.251866 18406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:39.251892 18404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:39.251883 18403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:39.252128 18398 server_base.cc:1034] running on GCE node
I20260619 02:44:39.252385 18398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:39.252694 18398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:39.253871 18398 hybrid_clock.cc:648] HybridClock initialized: now 1781837079253863 us; error 34 us; skew 500 ppm
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.260246 18398 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:44:39.260689 18398 webserver.cc:460] Webserver started at http://127.12.145.126:46867/ using document root <none> and password file <none>
I20260619 02:44:39.260882 18398 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:39.260921 18398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:39.261008 18398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:39.261994 18398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "c6bc4b1a5ed86b6c6a039acffd23122e"
server_key_iv: "3a7c03377136670f726b97592e90db87"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.262305 18398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "c6bc4b1a5ed86b6c6a039acffd23122e"
server_key_iv: "3a7c03377136670f726b97592e90db87"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.263607 18398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:39.264276 18413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.264423 18398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:39.264508 18398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "c6bc4b1a5ed86b6c6a039acffd23122e"
server_key_iv: "3a7c03377136670f726b97592e90db87"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.264562 18398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:39.272092 18398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:39.273664 18398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:39.273759 18398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:39.277283 18398 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:41705
I20260619 02:44:39.277366 18465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:41705 every 8 connection(s)
I20260619 02:44:39.277655 18398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:39.278477 18466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:39.280611 18466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5: Bootstrap starting.
I20260619 02:44:39.280880 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18398
I20260619 02:44:39.280985 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:39.281173 12869 external_mini_cluster.cc:1428] Setting key ec96613074f241464029b0e5d7093804
I20260619 02:44:39.281260 18466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:39.281594 18466 log.cc:824] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:39.282323 18466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5: No bootstrap required, opened a new log
I20260619 02:44:39.284644 18466 raft_consensus.cc:348] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41705 } }
I20260619 02:44:39.284811 18466 raft_consensus.cc:374] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:39.284855 18466 raft_consensus.cc:729] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d65a3f80a1f747f58d6fb5441ab9f4d5, State: Initialized, Role: FOLLOWER
I20260619 02:44:39.284976 18466 consensus_queue.cc:260] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41705 } }
I20260619 02:44:39.285050 18466 raft_consensus.cc:388] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:39.285092 18466 raft_consensus.cc:482] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:39.285140 18466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:39.285667 18466 raft_consensus.cc:504] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41705 } }
I20260619 02:44:39.285765 18466 leader_election.cc:302] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d65a3f80a1f747f58d6fb5441ab9f4d5; no voters:
I20260619 02:44:39.285903 18466 leader_election.cc:288] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:39.285948 18471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:39.286116 18471 raft_consensus.cc:686] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [term 1 LEADER]: Becoming Leader. State: Replica: d65a3f80a1f747f58d6fb5441ab9f4d5, State: Running, Role: LEADER
I20260619 02:44:39.286139 18466 sys_catalog.cc:564] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:39.286249 18471 consensus_queue.cc:237] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41705 } }
I20260619 02:44:39.288403 18473 sys_catalog.cc:455] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d65a3f80a1f747f58d6fb5441ab9f4d5. Latest consensus state: current_term: 1 leader_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41705 } } }
I20260619 02:44:39.288404 18472 sys_catalog.cc:455] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d65a3f80a1f747f58d6fb5441ab9f4d5" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 41705 } } }
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:39.288654 18473 sys_catalog.cc:458] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:39.288661 18472 sys_catalog.cc:458] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5 [sys.catalog]: This master's current role is: LEADER
W20260619 02:44:39.288823 18486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:44:39.288869 18486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:44:39.288923 18488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:39.289076 18488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:39.290529 18488 catalog_manager.cc:1347] Generated new cluster ID: 78eb1f5e0edc400a8c641acdfe7d5bde
I20260619 02:44:39.290629 18488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:39.292482 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.281648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51438 (local address 127.12.145.126:41705)
0619 02:44:39.281865 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.281872 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.281895 (+ 23us) server_negotiation.cc:407] Connection header received
0619 02:44:39.282469 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.282477 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.282532 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.282702 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.283288 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.284724 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.285635 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.286242 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.286753 (+ 511us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.289227 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:39.289231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:39.289231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:39.289241 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:39.291080 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.291432 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.291434 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.291435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.291517 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.291713 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.291714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.291714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.291932 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:39.292070 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:39.292185 (+ 115us) server_negotiation.cc:299] Negotiation successful
0619 02:44:39.292331 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":67,"threads_started":1}
I20260619 02:44:39.300045 18488 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:39.300539 18488 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:39.305361 18488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d65a3f80a1f747f58d6fb5441ab9f4d5: Generated new TSK 0
I20260619 02:44:39.305528 18488 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:44:39.332692 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41705
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:42547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:39.417171 18492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:39.417376 18492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:39.417411 18492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:39.418659 18492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:39.418717 18492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:39.418761 18492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:39.420275 18492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:42547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:39.420548 18492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:39.420773 18492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:39.426222 18497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:39.426293 18498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:39.426651 18500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:39.426865 18492 server_base.cc:1034] running on GCE node
I20260619 02:44:39.427058 18492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:39.427290 18492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:39.428490 18492 hybrid_clock.cc:648] HybridClock initialized: now 1781837079428466 us; error 38 us; skew 500 ppm
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.431028 18492 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:44:39.431478 18492 webserver.cc:460] Webserver started at http://127.12.145.65:33507/ using document root <none> and password file <none>
I20260619 02:44:39.431697 18492 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:39.431761 18492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:39.431922 18492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:39.432950 18492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "818d59a8817b4626b1da46b079cad7e6"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "f296dd764c97a24ec965ee9283258cdb"
server_key_iv: "7469e32a468c1c8248f47ccace1645e5"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.433297 18492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "818d59a8817b4626b1da46b079cad7e6"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "f296dd764c97a24ec965ee9283258cdb"
server_key_iv: "7469e32a468c1c8248f47ccace1645e5"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.434698 18492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:44:39.435487 18507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.435662 18492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:39.435756 18492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "818d59a8817b4626b1da46b079cad7e6"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "f296dd764c97a24ec965ee9283258cdb"
server_key_iv: "7469e32a468c1c8248f47ccace1645e5"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.435839 18492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:39.448670 18492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:39.450795 18492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:39.450939 18492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:39.451159 18492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:39.451478 18492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:39.451534 18492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.451566 18492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:39.451592 18492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.457121 18492 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:37101
I20260619 02:44:39.457176 18620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:37101 every 8 connection(s)
I20260619 02:44:39.457494 18492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:39.457888 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18492
I20260619 02:44:39.458009 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:44:39.458209 12869 external_mini_cluster.cc:1428] Setting key d8bcf75c66bd8864e34fc4b8a90fa6f1
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
I20260619 02:44:39.469393 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.458216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:41705 (local address 127.12.145.65:34647)
0619 02:44:39.458379 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:39.458427 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:39.459800 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:39.460163 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:39.460167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:39.460545 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:39.460812 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:39.460818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.461811 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.461812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:39.463242 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:39.463245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.463801 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.463802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:39.463959 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.464540 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:39.464550 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:39.466412 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:39.468130 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:39.468135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:39.468137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:39.468342 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:39.468556 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:39.468557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:39.468558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:39.468690 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:39.468917 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:39.468923 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:39.469047 (+ 124us) client_negotiation.cc:769] Sending connection context
0619 02:44:39.469129 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 02:44:39.469238 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260619 02:44:39.469403 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.458230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:34647 (local address 127.12.145.126:41705)
0619 02:44:39.458408 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.458410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.458522 (+ 112us) server_negotiation.cc:407] Connection header received
0619 02:44:39.459933 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.459934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.459947 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.459980 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.460915 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.461713 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.463335 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.463706 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.463789 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.466504 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:39.466505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:39.466505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:39.466512 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:39.467969 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.468418 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.468419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.468420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.468484 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.468747 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.468748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.468748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.468853 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:39.468922 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:39.469171 (+ 249us) server_negotiation.cc:299] Negotiation successful
0619 02:44:39.469270 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260619 02:44:39.469895 18621 heartbeater.cc:347] Connected to a master server at 127.12.145.126:41705
I20260619 02:44:39.469988 18621 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:39.470168 18621 heartbeater.cc:511] Master 127.12.145.126:41705 requested a full tablet report, sending...
I20260619 02:44:39.470729 18430 ts_manager.cc:194] Registered new tserver with Master: 818d59a8817b4626b1da46b079cad7e6 (127.12.145.65:37101)
I20260619 02:44:39.471307 18430 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:34647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:44:39.483319 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41705
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:42547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:39.560997 18626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:39.561183 18626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:39.561205 18626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:39.562337 18626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:39.562377 18626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:39.562403 18626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:39.563877 18626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:42547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:39.564117 18626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:39.564348 18626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:39.569057 18632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:39.569057 18631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:39.569106 18634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:39.569263 18626 server_base.cc:1034] running on GCE node
I20260619 02:44:39.569501 18626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:39.569778 18626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:39.570930 18626 hybrid_clock.cc:648] HybridClock initialized: now 1781837079570922 us; error 44 us; skew 500 ppm
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.573273 18626 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:44:39.573688 18626 webserver.cc:460] Webserver started at http://127.12.145.66:35413/ using document root <none> and password file <none>
I20260619 02:44:39.573921 18626 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:39.573987 18626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:39.574137 18626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:39.575220 18626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "7ba2337afee84d20a7a91b9c054659b6"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "b1193bb3ef02defc639f58c40681d4ed"
server_key_iv: "2e795882554db0d33a44be13ce9f2bd0"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.575562 18626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "7ba2337afee84d20a7a91b9c054659b6"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "b1193bb3ef02defc639f58c40681d4ed"
server_key_iv: "2e795882554db0d33a44be13ce9f2bd0"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.576825 18626 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:39.577597 18641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.577783 18626 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:39.577883 18626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "7ba2337afee84d20a7a91b9c054659b6"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "b1193bb3ef02defc639f58c40681d4ed"
server_key_iv: "2e795882554db0d33a44be13ce9f2bd0"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.577952 18626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:39.605433 18626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:39.607302 18626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:39.607462 18626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:39.607702 18626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:39.608007 18626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:39.608069 18626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.608105 18626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:39.608132 18626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.613554 18626 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:42147
I20260619 02:44:39.613656 18754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:42147 every 8 connection(s)
I20260619 02:44:39.613940 18626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:39.617645 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18626
I20260619 02:44:39.617746 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:39.617905 12869 external_mini_cluster.cc:1428] Setting key 9b331199c528f4d649b572ee2cabfec7
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:39.624157 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.614725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:39633 (local address 127.12.145.126:41705)
0619 02:44:39.614795 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.614796 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.615107 (+ 311us) server_negotiation.cc:407] Connection header received
0619 02:44:39.616054 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.616055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.616067 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.616120 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.616739 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.617236 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.618678 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.618867 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.618919 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.621393 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:39.621394 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:39.621394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:39.621401 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:39.622824 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.623226 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.623228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.623228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.623283 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.623547 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.623548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.623549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.623657 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:39.623729 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:39.623992 (+ 263us) server_negotiation.cc:299] Negotiation successful
0619 02:44:39.624066 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 02:44:39.624366 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.614716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:41705 (local address 127.12.145.66:39633)
0619 02:44:39.614987 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:39.615026 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:39.615928 (+ 902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:39.616188 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:39.616192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:39.616445 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:39.616632 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:39.616637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.617337 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.617339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:39.618598 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:39.618601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.618949 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.618951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:39.619114 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.619597 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:39.619607 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:39.621289 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:39.622921 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:39.622926 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:39.622928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:39.623140 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:39.623342 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:39.623343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:39.623344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:39.623472 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:39.623720 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:39.623725 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:39.623859 (+ 134us) client_negotiation.cc:769] Sending connection context
0619 02:44:39.623959 (+ 100us) client_negotiation.cc:240] Negotiation successful
0619 02:44:39.624120 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":74,"threads_started":1}
I20260619 02:44:39.624814 18755 heartbeater.cc:347] Connected to a master server at 127.12.145.126:41705
I20260619 02:44:39.624913 18755 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:39.625105 18755 heartbeater.cc:511] Master 127.12.145.126:41705 requested a full tablet report, sending...
I20260619 02:44:39.625444 18430 ts_manager.cc:194] Registered new tserver with Master: 7ba2337afee84d20a7a91b9c054659b6 (127.12.145.66:42147)
I20260619 02:44:39.625804 18430 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:39633
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:44:39.641439 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41705
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:42547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:39.720193 18760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:39.720376 18760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:39.720398 18760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:39.721447 18760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:39.721479 18760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:39.721513 18760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:39.722963 18760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:42547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:41705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:39.723136 18760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:39.723296 18760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:39.728135 18765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:39.728159 18766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:39.728318 18760 server_base.cc:1034] running on GCE node
W20260619 02:44:39.728401 18768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:39.728624 18760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:39.728860 18760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:39.730052 18760 hybrid_clock.cc:648] HybridClock initialized: now 1781837079730063 us; error 47 us; skew 500 ppm
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.732452 18760 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:44:39.732898 18760 webserver.cc:460] Webserver started at http://127.12.145.67:36145/ using document root <none> and password file <none>
I20260619 02:44:39.733141 18760 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:39.733208 18760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:39.733352 18760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:39.734324 18760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "25889bcd5b664e8f87d8d34530b74020"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "8c8d68b05218a99be530bdd47db5ff60"
server_key_iv: "52effc07c15aa3dfd79f9d084a8575b0"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.734714 18760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "25889bcd5b664e8f87d8d34530b74020"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "8c8d68b05218a99be530bdd47db5ff60"
server_key_iv: "52effc07c15aa3dfd79f9d084a8575b0"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.735980 18760 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:44:39.736673 18775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.736836 18760 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:39.736927 18760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "25889bcd5b664e8f87d8d34530b74020"
format_stamp: "Formatted at 2026-06-19 02:44:39 on dist-test-slave-fbl4"
server_key: "8c8d68b05218a99be530bdd47db5ff60"
server_key_iv: "52effc07c15aa3dfd79f9d084a8575b0"
server_key_version: "encryptionkey@0"
I20260619 02:44:39.737021 18760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:39.748493 18760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:39.750185 18760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:39.750348 18760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:39.750598 18760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:39.750895 18760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:39.750948 18760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.750988 18760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:39.751020 18760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:39.756843 18760 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:41137
I20260619 02:44:39.756896 18888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:41137 every 8 connection(s)
I20260619 02:44:39.757179 18760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:44:39.765556 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.757850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:60417 (local address 127.12.145.126:41705)
0619 02:44:39.757907 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.757909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.758113 (+ 204us) server_negotiation.cc:407] Connection header received
0619 02:44:39.759031 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.759033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.759043 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.759109 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.759646 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.760133 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.761015 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.761186 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.761234 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.763213 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:39.763215 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:39.763215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:39.763221 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:39.764512 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.764831 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.764832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.764832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.764879 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.765076 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.765077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.765077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.765171 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:39.765218 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:39.765420 (+ 202us) server_negotiation.cc:299] Negotiation successful
0619 02:44:39.765478 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:44:39.765722 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.757834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:41705 (local address 127.12.145.67:60417)
0619 02:44:39.757983 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:39.758027 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:39.758923 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:39.759163 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:39.759166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:39.759393 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:39.759568 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:39.759572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.760207 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.760207 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:39.760934 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:39.760948 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.761250 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.761251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:39.761354 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.761782 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:39.761790 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:39.763121 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:39.764579 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:39.764583 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:39.764585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:39.764772 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:39.764931 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:39.764932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:39.764932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:39.765026 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:39.765222 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:39.765225 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:39.765322 (+ 97us) client_negotiation.cc:769] Sending connection context
0619 02:44:39.765396 (+ 74us) client_negotiation.cc:240] Negotiation successful
0619 02:44:39.765508 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
I20260619 02:44:39.766196 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18760
I20260619 02:44:39.766203 18889 heartbeater.cc:347] Connected to a master server at 127.12.145.126:41705
I20260619 02:44:39.766311 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:39.766315 18889 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:39.766489 18889 heartbeater.cc:511] Master 127.12.145.126:41705 requested a full tablet report, sending...
I20260619 02:44:39.766533 12869 external_mini_cluster.cc:1428] Setting key a6a7429a783283b1cf1a97fe579fd54a
I20260619 02:44:39.766860 18430 ts_manager.cc:194] Registered new tserver with Master: 25889bcd5b664e8f87d8d34530b74020 (127.12.145.67:41137)
I20260619 02:44:39.767338 18430 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:60417
I20260619 02:44:39.767481 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/test-admin.keytab.
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.782855 12869 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260619 02:44:39.784343 18896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:39.783653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49238 (local address 127.12.145.65:37101)
0619 02:44:39.783803 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.783812 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.783821 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:39.783846 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.783847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.783859 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.783926 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.784244 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49238: BlockingRecv error: recv got EOF from 127.0.0.1:49238 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
W20260619 02:44:39.784443 12869 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc)
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.785388 12869 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.786294 12869 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:39.794066 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.786855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49250 (local address 127.12.145.65:37101)
0619 02:44:39.786905 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.786908 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.786953 (+ 45us) server_negotiation.cc:407] Connection header received
0619 02:44:39.787034 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.787035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.787046 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.787094 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.787553 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.788269 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.789060 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.789387 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.789465 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.791447 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:39.791454 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:39.791455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:39.791460 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:39.792997 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.793297 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.793299 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.793300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.793352 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.793529 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.793530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.793530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.793644 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:39.793736 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:39.793831 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 02:44:39.793935 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260619 02:44:39.795828 18896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:39.795276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49260 (local address 127.12.145.65:37101)
0619 02:44:39.795333 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.795335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.795359 (+ 24us) server_negotiation.cc:407] Connection header received
0619 02:44:39.795426 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.795427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.795437 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.795483 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.795779 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49260: BlockingRecv error: recv got EOF from 127.0.0.1:49260 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260619 02:44:39.795912 12869 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc' of type FILE
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.796819 12869 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.797609 12869 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:39.803596 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.798033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49274 (local address 127.12.145.65:37101)
0619 02:44:39.798071 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.798073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.798100 (+ 27us) server_negotiation.cc:407] Connection header received
0619 02:44:39.798142 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.798143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.798150 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.798195 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.798492 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.798963 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.799565 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.799737 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.799783 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.801512 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:39.801513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:39.801514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:39.801519 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:39.802831 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.803104 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.803105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.803105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.803150 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.803298 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.803298 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.803298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.803366 (+ 68us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:39.803424 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:39.803500 (+ 76us) server_negotiation.cc:299] Negotiation successful
0619 02:44:39.803550 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260619 02:44:39.805106 18896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:44:39.804577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49280 (local address 127.12.145.65:37101)
0619 02:44:39.804633 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.804635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.804695 (+ 60us) server_negotiation.cc:407] Connection header received
0619 02:44:39.804760 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.804761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.804769 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.804820 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.805067 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49280: BlockingRecv error: recv got EOF from 127.0.0.1:49280 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260619 02:44:39.805190 12869 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781837054956172-12869-0/krb5kdc/krb5cc' of type FILE
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.806124 12869 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:39.806979 12869 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18385](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:44:39.812718 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:39.807389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49288 (local address 127.12.145.65:37101)
0619 02:44:39.807424 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:39.807426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:39.807441 (+ 15us) server_negotiation.cc:407] Connection header received
0619 02:44:39.807487 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:39.807488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:39.807494 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:39.807538 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:39.807815 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.808222 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.808794 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:39.808949 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:39.809000 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:39.810853 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:39.810854 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:39.810854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:39.810859 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:39.811919 (+ 1060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.812206 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.812206 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.812207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.812253 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:39.812401 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:39.812401 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:39.812401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:39.812476 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:39.812554 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:39.812624 (+ 70us) server_negotiation.cc:299] Negotiation successful
0619 02:44:39.812670 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260619 02:44:39.813277 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18492
I20260619 02:44:39.817865 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18626
I20260619 02:44:39.822108 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18760
I20260619 02:44:39.826079 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18398
2026-06-19T02:44:39Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1800 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18909](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18909](info): set up 2 sockets
Jun 19 02:44:39 dist-test-slave-fbl4 krb5kdc[18909](info): commencing operation
krb5kdc: starting...
W20260619 02:44:40.846925 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.001s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:44:40 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:44:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:44:40Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab.
Entry for principal oryx/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab.
I20260619 02:44:40.962073 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:44767
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab
--principal=oryx/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:44767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:41.039744 18922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:41.039958 18922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:41.040000 18922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:41.041024 18922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:41.041085 18922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:41.041106 18922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:41.041124 18922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:41.041152 18922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:41.042520 18922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:44767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab
--principal=oryx/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:44767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:41.042798 18922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:41.043015 18922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:41.047618 18930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:41.047621 18928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:41.047650 18927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:41.047881 18922 server_base.cc:1034] running on GCE node
I20260619 02:44:41.048187 18922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:41.048441 18922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:41.049580 18922 hybrid_clock.cc:648] HybridClock initialized: now 1781837081049559 us; error 37 us; skew 500 ppm
Jun 19 02:44:41 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837081, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:41.051878 18922 init.cc:377] Logged in from keytab as oryx/127.12.145.126@KRBTEST.COM (short username oryx)
I20260619 02:44:41.052230 18922 webserver.cc:460] Webserver started at http://127.12.145.126:43305/ using document root <none> and password file <none>
I20260619 02:44:41.052418 18922 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:41.052469 18922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:41.052551 18922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:41.053457 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "3d3e97d189aa47f89e8ed33a531fb900"
format_stamp: "Formatted at 2026-06-19 02:44:41 on dist-test-slave-fbl4"
server_key: "7dee1c79599defae12885a0cf3e54697"
server_key_iv: "132ca3c0a1493c484913b88660563d45"
server_key_version: "encryptionkey@0"
I20260619 02:44:41.053735 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "3d3e97d189aa47f89e8ed33a531fb900"
format_stamp: "Formatted at 2026-06-19 02:44:41 on dist-test-slave-fbl4"
server_key: "7dee1c79599defae12885a0cf3e54697"
server_key_iv: "132ca3c0a1493c484913b88660563d45"
server_key_version: "encryptionkey@0"
I20260619 02:44:41.054986 18922 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:44:41.055737 18937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:41.055902 18922 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:41.055984 18922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "3d3e97d189aa47f89e8ed33a531fb900"
format_stamp: "Formatted at 2026-06-19 02:44:41 on dist-test-slave-fbl4"
server_key: "7dee1c79599defae12885a0cf3e54697"
server_key_iv: "132ca3c0a1493c484913b88660563d45"
server_key_version: "encryptionkey@0"
I20260619 02:44:41.056041 18922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:41.068688 18922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:41.070345 18922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:41.070443 18922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:41.074183 18922 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:44767
I20260619 02:44:41.074249 18989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:44767 every 8 connection(s)
I20260619 02:44:41.074676 18922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:44:41.075634 18990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:41.076233 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 18922
I20260619 02:44:41.076333 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:44:41.076531 12869 external_mini_cluster.cc:1428] Setting key 57c4365373b7c58438a27026d9cf6cbd
I20260619 02:44:41.078717 18990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: Bootstrap starting.
I20260619 02:44:41.079257 18990 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:41.079545 18990 log.cc:824] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:41.080219 18990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: No bootstrap required, opened a new log
I20260619 02:44:41.082729 18990 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } }
I20260619 02:44:41.082878 18990 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:41.082902 18990 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3e97d189aa47f89e8ed33a531fb900, State: Initialized, Role: FOLLOWER
I20260619 02:44:41.083041 18990 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } }
I20260619 02:44:41.083122 18990 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:44:41.083144 18990 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:44:41.083209 18990 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 0 FOLLOWER]: Advancing to term 1
Jun 19 02:44:41 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:44:41.083783 18990 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } }
I20260619 02:44:41.083887 18990 leader_election.cc:302] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d3e97d189aa47f89e8ed33a531fb900; no voters:
I20260619 02:44:41.084056 18990 leader_election.cc:288] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:44:41.084321 18990 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:41.084085 18995 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:41.084499 18995 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3e97d189aa47f89e8ed33a531fb900, State: Running, Role: LEADER
I20260619 02:44:41.084622 18995 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } }
I20260619 02:44:41.085440 18996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } }
I20260619 02:44:41.085515 18996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:41.085692 18997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3e97d189aa47f89e8ed33a531fb900. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } }
I20260619 02:44:41.085745 18997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: This master's current role is: LEADER
W20260619 02:44:41.086154 19009 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:44:41.086205 19009 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:44:41.086337 19010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:44:41.086501 19010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:44:41.087463 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:41.077021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34580 (local address 127.12.145.126:44767)
0619 02:44:41.077186 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:41.077195 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:41.077246 (+ 51us) server_negotiation.cc:407] Connection header received
0619 02:44:41.077636 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:41.077643 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:41.077685 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:41.077793 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:41.078606 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:41.079620 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:41.080603 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:41.080968 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:41.081053 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:41.083830 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:41.083834 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:41.083835 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:41.083847 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:41.085970 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:41.086343 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:41.086346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:41.086346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:41.086443 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:41.086645 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:41.086646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:41.086647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:41.086867 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:41.087019 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:41.087122 (+ 103us) server_negotiation.cc:299] Negotiation successful
0619 02:44:41.087255 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260619 02:44:41.087890 19010 catalog_manager.cc:1347] Generated new cluster ID: 24794ed8efcd42c89ccd3efa0c103bb4
I20260619 02:44:41.087936 19010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:44:41.103175 19010 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:44:41.103902 19010 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:44:41.112186 19010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: Generated new TSK 0
I20260619 02:44:41.112380 19010 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab.
Entry for principal oryx/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab.
W20260619 02:44:42.591303 12869 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.12.145.65: real 1.474s user 0.000s sys 0.003s
I20260619 02:44:42.591661 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:44767
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab
--principal=oryx/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:42.675963 19016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:42.676173 19016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:42.676196 19016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:42.677413 19016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:42.677456 19016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:42.677482 19016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:42.678968 19016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab
--principal=oryx/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:44767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:42.679168 19016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:42.679375 19016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:42.684059 19022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:42.684053 19021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:42.684052 19024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:42.684314 19016 server_base.cc:1034] running on GCE node
I20260619 02:44:42.684594 19016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:42.684907 19016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:42.686125 19016 hybrid_clock.cc:648] HybridClock initialized: now 1781837082686108 us; error 34 us; skew 500 ppm
Jun 19 02:44:42 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837082, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:42.688566 19016 init.cc:377] Logged in from keytab as oryx/127.12.145.65@KRBTEST.COM (short username oryx)
I20260619 02:44:42.688925 19016 webserver.cc:460] Webserver started at http://127.12.145.65:36877/ using document root <none> and password file <none>
I20260619 02:44:42.689111 19016 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:42.689196 19016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:42.689332 19016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:42.690299 19016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "c34c166ec3324133846339e755ffc4eb"
format_stamp: "Formatted at 2026-06-19 02:44:42 on dist-test-slave-fbl4"
server_key: "4626c0b4fe39bc04131a9425391bcb6a"
server_key_iv: "6f9a9e72ed38ac349408e813087a2a15"
server_key_version: "encryptionkey@0"
I20260619 02:44:42.690680 19016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "c34c166ec3324133846339e755ffc4eb"
format_stamp: "Formatted at 2026-06-19 02:44:42 on dist-test-slave-fbl4"
server_key: "4626c0b4fe39bc04131a9425391bcb6a"
server_key_iv: "6f9a9e72ed38ac349408e813087a2a15"
server_key_version: "encryptionkey@0"
I20260619 02:44:42.691957 19016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:44:42.692726 19031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:42.692895 19016 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:42.693005 19016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "c34c166ec3324133846339e755ffc4eb"
format_stamp: "Formatted at 2026-06-19 02:44:42 on dist-test-slave-fbl4"
server_key: "4626c0b4fe39bc04131a9425391bcb6a"
server_key_iv: "6f9a9e72ed38ac349408e813087a2a15"
server_key_version: "encryptionkey@0"
I20260619 02:44:42.693086 19016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:42.733035 19016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:42.734941 19016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:42.735101 19016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:42.735334 19016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:42.735642 19016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:42.735698 19016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:42.735740 19016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:42.735765 19016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:42.741144 19016 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:36107
I20260619 02:44:42.741247 19144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:36107 every 8 connection(s)
I20260619 02:44:42.741555 19016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:42.747234 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 19016
I20260619 02:44:42.747354 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
Jun 19 02:44:42 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837082, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:44:42.747582 12869 external_mini_cluster.cc:1428] Setting key 6c0cea9ed413962e3930be0f1331e140
I20260619 02:44:42.751267 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:42.742274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:50613 (local address 127.12.145.126:44767)
0619 02:44:42.742417 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:42.742419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:42.742562 (+ 143us) server_negotiation.cc:407] Connection header received
0619 02:44:42.743113 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:42.743114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:42.743127 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:42.743188 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:42.744097 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:42.744620 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:42.745602 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:42.745826 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:42.745911 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:42.748106 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:42.748107 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:42.748108 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:42.748114 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:42.749758 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:42.750255 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:42.750256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:42.750256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:42.750312 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:42.750633 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:42.750634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:42.750634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:42.750743 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:42.750797 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:42.751131 (+ 334us) server_negotiation.cc:299] Negotiation successful
0619 02:44:42.751199 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260619 02:44:42.751533 19147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:42.742244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:50613)
0619 02:44:42.742419 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:42.742469 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:42.743008 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:42.743262 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:42.743265 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:42.743822 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:42.743995 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:42.744000 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:42.744712 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:42.744713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:42.745498 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:42.745501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:42.745919 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:42.745920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:42.746046 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:42.746561 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:42.746570 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:42.748027 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:42.749833 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:42.749840 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:42.749843 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:42.750178 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:42.750379 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:42.750379 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:42.750380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:42.750519 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:42.750807 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:42.750812 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:42.750990 (+ 178us) client_negotiation.cc:769] Sending connection context
0619 02:44:42.751097 (+ 107us) client_negotiation.cc:240] Negotiation successful
0619 02:44:42.751261 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
I20260619 02:44:42.752056 19145 heartbeater.cc:347] Connected to a master server at 127.12.145.126:44767
I20260619 02:44:42.752182 19145 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:42.752373 19145 heartbeater.cc:511] Master 127.12.145.126:44767 requested a full tablet report, sending...
I20260619 02:44:42.752915 18954 ts_manager.cc:194] Registered new tserver with Master: c34c166ec3324133846339e755ffc4eb (127.12.145.65:36107)
I20260619 02:44:42.753481 18954 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:50613
WARNING: no policy specified for oryx/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab.
Entry for principal oryx/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab.
W20260619 02:44:42.943454 12869 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.12.145.66: real 0.195s user 0.000s sys 0.003s
I20260619 02:44:42.943785 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:44767
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab
--principal=oryx/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:43.023068 19151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:43.023285 19151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:43.023325 19151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:43.024475 19151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:43.024539 19151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:43.024585 19151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:43.025992 19151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab
--principal=oryx/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:44767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:43.026240 19151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:43.026465 19151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.031239 19157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.031208 19156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.031224 19151 server_base.cc:1034] running on GCE node
W20260619 02:44:43.031208 19159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.031608 19151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.031852 19151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.032998 19151 hybrid_clock.cc:648] HybridClock initialized: now 1781837083032987 us; error 28 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.035470 19151 init.cc:377] Logged in from keytab as oryx/127.12.145.66@KRBTEST.COM (short username oryx)
I20260619 02:44:43.035929 19151 webserver.cc:460] Webserver started at http://127.12.145.66:38445/ using document root <none> and password file <none>
I20260619 02:44:43.036144 19151 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.036207 19151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.036347 19151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:43.037405 19151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "d58e5113dac04d62981bddf7b753a2a0"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "fceac28b538e2494160c6e36f4a1dcab"
server_key_iv: "d4e77e356c6f2c118271bf9b96af5b90"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.037787 19151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "d58e5113dac04d62981bddf7b753a2a0"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "fceac28b538e2494160c6e36f4a1dcab"
server_key_iv: "d4e77e356c6f2c118271bf9b96af5b90"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.039172 19151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:44:43.039872 19166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.040030 19151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:43.040123 19151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "d58e5113dac04d62981bddf7b753a2a0"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "fceac28b538e2494160c6e36f4a1dcab"
server_key_iv: "d4e77e356c6f2c118271bf9b96af5b90"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.040195 19151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.065651 19151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.068009 19151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:43.068171 19151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.068380 19151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:43.068661 19151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:43.068709 19151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.068740 19151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:43.068768 19151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.074301 19151 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34161
I20260619 02:44:43.074360 19279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34161 every 8 connection(s)
I20260619 02:44:43.074753 19151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:43.078450 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 19151
I20260619 02:44:43.078573 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:44:43.078779 12869 external_mini_cluster.cc:1428] Setting key d6c0e8a179a40ebe3c26441cde8bf681
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:44:43.084604 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.075473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:58833 (local address 127.12.145.126:44767)
0619 02:44:43.075542 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.075544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.075716 (+ 172us) server_negotiation.cc:407] Connection header received
0619 02:44:43.076174 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.076175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.076185 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.076244 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.077118 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.077611 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.078664 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.078974 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.079070 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.081444 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.081445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.081445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.081451 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.083055 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.083564 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.083565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.083565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.083613 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.083924 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.083925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.083925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.084026 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.084078 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.084409 (+ 331us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.084519 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:44:43.084864 19282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.075444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:58833)
0619 02:44:43.075610 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.075647 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.076093 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.076312 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.076315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.076856 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.077037 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.077041 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.077688 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.077689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.078529 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.078531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.079070 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.079071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.079194 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.079740 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.079753 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.081346 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.083137 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.083144 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.083146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.083472 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.083698 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.083699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.083699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.083849 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.084095 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.084102 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.084270 (+ 168us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.084396 (+ 126us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.084603 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260619 02:44:43.085350 19280 heartbeater.cc:347] Connected to a master server at 127.12.145.126:44767
I20260619 02:44:43.085449 19280 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:43.085633 19280 heartbeater.cc:511] Master 127.12.145.126:44767 requested a full tablet report, sending...
I20260619 02:44:43.086026 18954 ts_manager.cc:194] Registered new tserver with Master: d58e5113dac04d62981bddf7b753a2a0 (127.12.145.66:34161)
I20260619 02:44:43.086373 18954 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:58833
WARNING: no policy specified for oryx/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab.
Entry for principal oryx/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab.
I20260619 02:44:43.104934 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:44767
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab
--principal=oryx/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:43.184921 19285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:43.185128 19285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:43.185163 19285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:43.186281 19285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:43.186344 19285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:43.186395 19285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:43.187839 19285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab
--principal=oryx/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:44767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:43.188095 19285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:43.188313 19285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.193001 19293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.193022 19290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.193117 19291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.193120 19285 server_base.cc:1034] running on GCE node
I20260619 02:44:43.193401 19285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.193662 19285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.194819 19285 hybrid_clock.cc:648] HybridClock initialized: now 1781837083194813 us; error 34 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.197255 19285 init.cc:377] Logged in from keytab as oryx/127.12.145.67@KRBTEST.COM (short username oryx)
I20260619 02:44:43.197666 19285 webserver.cc:460] Webserver started at http://127.12.145.67:41749/ using document root <none> and password file <none>
I20260619 02:44:43.197892 19285 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.197958 19285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.198112 19285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:43.199194 19285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "a3cd3061e2d844ad9fd4c31a045d2308"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "bdd0aa67c6f00cadde2a64b0b57e520f"
server_key_iv: "f5fc3dd9e9d487d75d3452bbac735bc8"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.199535 19285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "a3cd3061e2d844ad9fd4c31a045d2308"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "bdd0aa67c6f00cadde2a64b0b57e520f"
server_key_iv: "f5fc3dd9e9d487d75d3452bbac735bc8"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.200726 19285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:44:43.201357 19300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.201519 19285 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:43.201606 19285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "a3cd3061e2d844ad9fd4c31a045d2308"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "bdd0aa67c6f00cadde2a64b0b57e520f"
server_key_iv: "f5fc3dd9e9d487d75d3452bbac735bc8"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.201681 19285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.227087 19285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.229002 19285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:43.229173 19285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.229394 19285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:43.229699 19285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:43.229753 19285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.229794 19285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:43.229821 19285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.235405 19285 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:41189
I20260619 02:44:43.235448 19413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:41189 every 8 connection(s)
I20260619 02:44:43.235746 19285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:44:43.239377 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 19285
I20260619 02:44:43.239494 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:44:43.239662 12869 external_mini_cluster.cc:1428] Setting key 97fa804decda2687f4004e9a9f547825
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:44:43.244683 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.236423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:47255 (local address 127.12.145.126:44767)
0619 02:44:43.236512 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.236515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.236689 (+ 174us) server_negotiation.cc:407] Connection header received
0619 02:44:43.237132 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.237133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.237143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.237194 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.238073 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.238597 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.239566 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.239777 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.239862 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.241945 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.241946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.241947 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.241954 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.243325 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.243747 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.243749 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.243749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.243823 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.244069 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.244070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.244070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.244182 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.244257 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.244511 (+ 254us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.244586 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 02:44:43.244869 19416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.236383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:47255)
0619 02:44:43.236569 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.236603 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.237049 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.237245 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.237248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.237782 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.237958 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.237962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.238680 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.238681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.239452 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.239454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.239870 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.239871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.240016 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.240491 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.240499 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.241844 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.243425 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.243431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.243433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.243657 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.243895 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.243896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.243896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.244000 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.244248 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.244253 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.244388 (+ 135us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.244493 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.244650 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":104,"threads_started":1}
I20260619 02:44:43.245283 19414 heartbeater.cc:347] Connected to a master server at 127.12.145.126:44767
I20260619 02:44:43.245369 19414 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:43.245498 19414 heartbeater.cc:511] Master 127.12.145.126:44767 requested a full tablet report, sending...
I20260619 02:44:43.245805 18954 ts_manager.cc:194] Registered new tserver with Master: a3cd3061e2d844ad9fd4c31a045d2308 (127.12.145.67:41189)
I20260619 02:44:43.246117 18954 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:47255
I20260619 02:44:43.251266 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.145.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.125.keytab.
Entry for principal oryx/127.12.145.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.125.keytab.
I20260619 02:44:43.274974 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:44561
--webserver_interface=127.12.145.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.125.keytab
--principal=oryx/127.12.145.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:44767,127.12.145.125:44561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:43.356040 19419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:43.356235 19419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:43.356256 19419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:43.357306 19419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:43.357342 19419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:43.357357 19419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:43.357375 19419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:43.357388 19419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:43.358963 19419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:44767,127.12.145.125:44561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.125.keytab
--principal=oryx/127.12.145.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:44561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
W20260619 02:44:43.359063 19419 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.145.126:44767,127.12.145.125:44561'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260619 02:44:43.359211 19419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:43.359390 19419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.363955 19424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.363942 19425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.363943 19427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.364185 19419 server_base.cc:1034] running on GCE node
I20260619 02:44:43.364440 19419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.364696 19419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.365872 19419 hybrid_clock.cc:648] HybridClock initialized: now 1781837083365855 us; error 24 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.368284 19419 init.cc:377] Logged in from keytab as oryx/127.12.145.125@KRBTEST.COM (short username oryx)
I20260619 02:44:43.368806 19419 webserver.cc:460] Webserver started at http://127.12.145.125:46551/ using document root <none> and password file <none>
I20260619 02:44:43.369061 19419 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.369127 19419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.369278 19419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:43.370273 19419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/instance:
uuid: "c66bed1646e14da3b41d249045ef6aa3"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "a764fabd74fb68760e848fdf24ab64e3"
server_key_iv: "ffb4edbb796bfe27a71c03ea921cb01b"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.370671 19419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal/instance:
uuid: "c66bed1646e14da3b41d249045ef6aa3"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "a764fabd74fb68760e848fdf24ab64e3"
server_key_iv: "ffb4edbb796bfe27a71c03ea921cb01b"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.371903 19419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:43.372658 19434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.372886 19419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:43.372984 19419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
uuid: "c66bed1646e14da3b41d249045ef6aa3"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "a764fabd74fb68760e848fdf24ab64e3"
server_key_iv: "ffb4edbb796bfe27a71c03ea921cb01b"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.373068 19419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.386050 19419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.387761 19419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:43.387908 19419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.391842 19419 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.125:44561
I20260619 02:44:43.391873 19486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.125:44561 every 8 connection(s)
I20260619 02:44:43.392199 19419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
I20260619 02:44:43.393086 19487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:43.394479 19487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:44:43.399286 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 19419
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.125@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:44:43.403452 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.395258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34586 (local address 127.12.145.126:44767)
0619 02:44:43.395321 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.395323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.395481 (+ 158us) server_negotiation.cc:407] Connection header received
0619 02:44:43.396042 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.396043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.396052 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.396111 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.396654 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.397223 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.398214 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.398387 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.398435 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.400578 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.400579 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.400579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.400587 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.401901 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.402299 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.402300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.402301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.402359 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.402657 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.402658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.402658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.402880 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.402953 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.403298 (+ 345us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.403379 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260619 02:44:43.403723 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.395227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:34586)
0619 02:44:43.395373 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.395411 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.395963 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.396158 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.396161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.396375 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.396588 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.396591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.397310 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.397311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.398143 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.398145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.398448 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.398449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.398539 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.399048 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.399056 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.400488 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.402007 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.402012 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.402014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.402223 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.402428 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.402429 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.402430 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.402542 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.402972 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.402978 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.403144 (+ 166us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.403276 (+ 132us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.403463 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260619 02:44:43.404404 19487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.125@KRBTEST.COM
I20260619 02:44:43.408401 19491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.399791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53084 (local address 127.12.145.125:44561)
0619 02:44:43.399962 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.399967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.400025 (+ 58us) server_negotiation.cc:407] Connection header received
0619 02:44:43.400065 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.400068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.400086 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.400145 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.400747 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.401379 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.402064 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.402351 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.402433 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.405253 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.405258 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.405258 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.405264 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.406892 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.407260 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.407262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.407262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.407323 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.407562 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.407563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.407563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.407857 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.408003 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.408058 (+ 55us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.408135 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.125@KRBTEST.COM for oryx/127.12.145.125@KRBTEST.COM
I20260619 02:44:43.411163 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.404635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.0.0.1:53096)
0619 02:44:43.404683 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.404693 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.404730 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.404919 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.404920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.405066 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.405103 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.405104 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.406019 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.406020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.406792 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.406795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.407256 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.407256 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.407325 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.407724 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.407728 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.409061 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.410352 (+ 1291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.410353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.410353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.410517 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.410744 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.410744 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.410745 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.410794 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.410961 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.410962 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.410993 (+ 31us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.411043 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.411110 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260619 02:44:43.411275 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.404690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.12.145.125:44561)
0619 02:44:43.404826 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.404828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.404835 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:44:43.404852 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.404852 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.404860 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.404919 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.405180 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.405943 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.406872 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.407168 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.407248 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.409135 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.409136 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.409136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.409141 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.410281 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.410638 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.410639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.410639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.410688 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.410835 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.410835 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.410836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.410915 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.410958 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.411057 (+ 99us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.411152 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260619 02:44:43.412361 19487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Bootstrap starting.
I20260619 02:44:43.412899 19487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:43.413120 19487 log.cc:824] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:43.413728 19487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: No bootstrap required, opened a new log
I20260619 02:44:43.415102 19487 raft_consensus.cc:348] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } }
I20260619 02:44:43.415210 19487 raft_consensus.cc:374] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:43.415231 19487 raft_consensus.cc:729] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66bed1646e14da3b41d249045ef6aa3, State: Initialized, Role: FOLLOWER
I20260619 02:44:43.415343 19487 consensus_queue.cc:260] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } }
I20260619 02:44:43.415568 19494 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } } }
I20260619 02:44:43.415643 19487 sys_catalog.cc:564] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:43.415650 19494 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: This master's current role is: FOLLOWER
W20260619 02:44:43.416996 19505 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:44:43.417094 19505 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:44:43.418517 19419 master_runner.cc:428] Detected that this master c66bed1646e14da3b41d249045ef6aa3 is joining an existing cluster
I20260619 02:44:43.418596 19419 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.145.125:44561
I20260619 02:44:43.425729 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.419633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53108 (local address 127.12.145.125:44561)
0619 02:44:43.419671 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.419672 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.419729 (+ 57us) server_negotiation.cc:407] Connection header received
0619 02:44:43.419793 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.419794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.419803 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.419853 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.420272 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.420743 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.421573 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.421856 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.421889 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.422903 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.422904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.422904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.422911 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.424634 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.424996 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.424997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.424997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.425055 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.425224 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.425225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.425226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.425332 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.425407 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.425548 (+ 141us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.425656 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":19}
I20260619 02:44:43.425808 19511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.419522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.0.0.1:53108)
0619 02:44:43.419680 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.419690 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.419742 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.419887 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.419888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.420122 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.420192 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.420194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.420801 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.420802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.421493 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.421495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.421968 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.421968 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.422039 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.422454 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.422459 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.422806 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.424731 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.424732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.424733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.424917 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.425119 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.425120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.425120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.425172 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.425399 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.425399 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.425436 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.425502 (+ 66us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.425605 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":76,"threads_started":1}
I20260619 02:44:43.427095 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.419588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34600 (local address 127.12.145.126:44767)
0619 02:44:43.419630 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.419632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.419893 (+ 261us) server_negotiation.cc:407] Connection header received
0619 02:44:43.419941 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.419942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.419952 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.420015 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.420302 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.421055 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.422035 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.422336 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.422434 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.424087 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.424088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.424089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.424095 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.425785 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.426168 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.426169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.426170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.426234 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.426597 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.426598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.426598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.426715 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.426790 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.426939 (+ 149us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.427014 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:44:43.427105 19512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.419524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:34600)
0619 02:44:43.419824 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.419831 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.419892 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.420025 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.420026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.420184 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.420229 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.420231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.421141 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.421142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.421953 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.421954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.422914 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.422915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.422981 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.423578 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.423583 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.423985 (+ 402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.425879 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.425880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.425880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.426090 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.426290 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.426290 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.426291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.426346 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.426782 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.426783 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.426821 (+ 38us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.426916 (+ 95us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.427007 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":81,"threads_started":1}
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837081, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.126@KRBTEST.COM for oryx/127.12.145.125@KRBTEST.COM
I20260619 02:44:43.436014 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.429008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.0.0.1:53120)
0619 02:44:43.429135 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.429180 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.429249 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.429379 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.429381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.429701 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.429754 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.429756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.430307 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.430308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.431261 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.431263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.431596 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.431597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.431672 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.432039 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.432044 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.433382 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.435065 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.435072 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.435073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.435270 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.435474 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.435475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.435475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.435527 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.435756 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.435761 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.435798 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.435866 (+ 68us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.435953 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":74,"threads_started":1}
I20260619 02:44:43.436053 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.429077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53120 (local address 127.12.145.125:44561)
0619 02:44:43.429159 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.429162 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.429227 (+ 65us) server_negotiation.cc:407] Connection header received
0619 02:44:43.429318 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.429319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.429325 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.429363 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.429825 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.430233 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.431355 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.431526 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.431577 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.433457 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.433458 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.433458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.433465 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.434983 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.435344 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.435345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.435345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.435407 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.435582 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.435583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.435583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.435697 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.435759 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.435902 (+ 143us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.435973 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 02:44:43.436558 18954 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.145.125:44561: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3"
member_type: NON_VOTER
last_known_addr {
host: "127.12.145.125"
port: 44561
}
attrs {
promote: true
}
}
dest_uuid: "3d3e97d189aa47f89e8ed33a531fb900"
cas_config_opid_index: -1
I20260619 02:44:43.436856 18954 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } }
I20260619 02:44:43.437347 19515 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER c66bed1646e14da3b41d249045ef6aa3 (127.12.145.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } }
I20260619 02:44:43.437647 19461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:43.438432 19515 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.145.125:44561
I20260619 02:44:43.438578 19461 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Refusing update from remote peer 3d3e97d189aa47f89e8ed33a531fb900: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260619 02:44:43.438627 19515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } }
I20260619 02:44:43.438655 19419 master.cc:537] Master@127.12.145.125:44561 shutting down...
I20260619 02:44:43.438689 19515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:43.439054 19516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 02:44:43.439805 18940 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260619 02:44:43.440460 18940 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 -> Peer c66bed1646e14da3b41d249045ef6aa3 (127.12.145.125:44561): Couldn't send request to peer c66bed1646e14da3b41d249045ef6aa3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260619 02:44:43.441447 19419 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:43.441535 19419 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:43.441586 19419 tablet_replica.cc:330] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: stopping tablet replica
I20260619 02:44:43.443953 19419 master.cc:552] Master@127.12.145.125:44561 shutdown complete.
I20260619 02:44:43.443989 19419 master_runner.cc:305] Clearing existing system tablet
I20260619 02:44:43.444083 19419 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.444131 19419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.444674 19419 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:43.445116 19520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.445303 19419 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.445421 19419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:44:43.445456 19419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
uuid: "c66bed1646e14da3b41d249045ef6aa3"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "a764fabd74fb68760e848fdf24ab64e3"
server_key_iv: "ffb4edbb796bfe27a71c03ea921cb01b"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.446070 19419 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:43.447506 19419 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260619 02:44:43.447561 19419 log.cc:1196] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260619 02:44:43.447760 19419 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Deleting consensus metadata
I20260619 02:44:43.447885 19419 master_runner.cc:315] Copying system tablet from 127.12.145.126:44767
I20260619 02:44:43.448449 19419 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.12.145.126:44767
I20260619 02:44:43.454514 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.448697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:34612)
0619 02:44:43.448809 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.448820 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.448881 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.449007 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.449008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.449139 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.449182 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.449183 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.450089 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.450090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.450701 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.450703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.451153 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.451154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.451198 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.451689 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.451694 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.451982 (+ 288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.453596 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.453597 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.453597 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.453756 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.453951 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.453952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.453952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.454001 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.454251 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.454251 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.454285 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.454336 (+ 51us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.454419 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":74,"threads_started":1}
I20260619 02:44:43.454538 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.448746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34612 (local address 127.12.145.126:44767)
0619 02:44:43.448789 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.448791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.448870 (+ 79us) server_negotiation.cc:407] Connection header received
0619 02:44:43.448937 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.448937 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.448946 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.449006 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.449245 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.450009 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.450771 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.451079 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.451151 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.452069 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.452070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.452071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.452078 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.453517 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.453826 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.453827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.453828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.453886 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.454059 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.454060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.454060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.454187 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.454257 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.454360 (+ 103us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.454445 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:44:43.455122 18974 tablet_copy_service.cc:140] P 3d3e97d189aa47f89e8ed33a531fb900: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c66bed1646e14da3b41d249045ef6aa3 ({username='oryx', principal='oryx/127.12.145.125@KRBTEST.COM'} at 127.0.0.1:34612)
I20260619 02:44:43.455219 18974 tablet_copy_service.cc:161] P 3d3e97d189aa47f89e8ed33a531fb900: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c66bed1646e14da3b41d249045ef6aa3 at {username='oryx', principal='oryx/127.12.145.125@KRBTEST.COM'} at 127.0.0.1:34612: session id = c66bed1646e14da3b41d249045ef6aa3-00000000000000000000000000000000
I20260619 02:44:43.455799 18974 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 02:44:43.456379 19419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260619 02:44:43.457211 19419 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: tablet copy: Starting download of 0 data blocks...
I20260619 02:44:43.457350 19419 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: tablet copy: Starting download of 1 WAL segments...
I20260619 02:44:43.458127 19419 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 02:44:43.459031 18974 tablet_copy_service.cc:342] P 3d3e97d189aa47f89e8ed33a531fb900: Request end of tablet copy session c66bed1646e14da3b41d249045ef6aa3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.145.125@KRBTEST.COM'} at 127.0.0.1:34612
I20260619 02:44:43.459115 18974 tablet_copy_service.cc:433] P 3d3e97d189aa47f89e8ed33a531fb900: ending tablet copy session c66bed1646e14da3b41d249045ef6aa3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c66bed1646e14da3b41d249045ef6aa3
I20260619 02:44:43.461299 19419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.462265 19528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.462391 19527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.462471 19530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.462718 19419 server_base.cc:1034] running on GCE node
I20260619 02:44:43.462809 19419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.462934 19419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.464059 19419 hybrid_clock.cc:648] HybridClock initialized: now 1781837083464050 us; error 23 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.465438 19419 init.cc:377] Logged in from keytab as oryx/127.12.145.125@KRBTEST.COM (short username oryx)
I20260619 02:44:43.465693 19419 webserver.cc:460] Webserver started at http://127.12.145.125:41431/ using document root <none> and password file <none>
I20260619 02:44:43.465806 19419 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.465842 19419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.466523 19419 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:43.467123 19537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.467259 19419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:44:43.467310 19419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
uuid: "c66bed1646e14da3b41d249045ef6aa3"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "a764fabd74fb68760e848fdf24ab64e3"
server_key_iv: "ffb4edbb796bfe27a71c03ea921cb01b"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.467357 19419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.497138 19419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.498669 19419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.501633 19419 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.125:44561
I20260619 02:44:43.501811 19589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.125:44561 every 8 connection(s)
I20260619 02:44:43.501996 19419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
I20260619 02:44:43.502758 19590 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:44:43.503126 19590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Bootstrap starting.
I20260619 02:44:43.505389 19590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:44:43.505656 19590 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: Bootstrap complete.
I20260619 02:44:43.505836 19590 raft_consensus.cc:348] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } }
I20260619 02:44:43.505913 19590 raft_consensus.cc:729] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c66bed1646e14da3b41d249045ef6aa3, State: Initialized, Role: LEARNER
I20260619 02:44:43.505952 19590 consensus_queue.cc:260] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } }
I20260619 02:44:43.506127 19590 sys_catalog.cc:564] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:43.506107 19593 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } }
I20260619 02:44:43.506170 19593 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: This master's current role is: LEARNER
I20260619 02:44:43.507450 19604 catalog_manager.cc:1259] Loaded cluster ID: 24794ed8efcd42c89ccd3efa0c103bb4
I20260619 02:44:43.507498 19604 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: loading cluster ID for follower catalog manager: success
I20260619 02:44:43.508369 19604 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: acquiring CA information for follower catalog manager: success
I20260619 02:44:43.508633 19604 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 02:44:43.516420 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.509846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37046 (local address 127.12.145.125:44561)
0619 02:44:43.509953 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.509955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.509963 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:43.509985 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.509985 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.509995 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.510062 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.510584 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.511559 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.512243 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.512544 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.512636 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.513776 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.513778 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.513778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.513784 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.515379 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.515694 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.515696 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.515696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.515760 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.515936 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.515937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.515937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.516065 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.516183 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.516249 (+ 66us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.516326 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":40,"threads_started":1}
WARNING: no policy specified for oryx/127.12.145.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.124.keytab.
Entry for principal oryx/127.12.145.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.124.keytab.
I20260619 02:44:43.541448 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:38175
--webserver_interface=127.12.145.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.124.keytab
--principal=oryx/127.12.145.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:44:43.621683 19608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:43.621862 19608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:43.621883 19608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:43.623067 19608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:44:43.623108 19608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:43.623122 19608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:43.623135 19608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:44:43.623179 19608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:44:43.624594 19608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.124.keytab
--principal=oryx/127.12.145.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:38175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:43.624791 19608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:43.624996 19608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.629604 19613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.629626 19616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.629627 19614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.629742 19608 server_base.cc:1034] running on GCE node
I20260619 02:44:43.629988 19608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.630296 19608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.631465 19608 hybrid_clock.cc:648] HybridClock initialized: now 1781837083631457 us; error 36 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.633848 19608 init.cc:377] Logged in from keytab as oryx/127.12.145.124@KRBTEST.COM (short username oryx)
I20260619 02:44:43.634248 19608 webserver.cc:460] Webserver started at http://127.12.145.124:41283/ using document root <none> and password file <none>
I20260619 02:44:43.634481 19608 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.634549 19608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.634716 19608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:44:43.635696 19608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/instance:
uuid: "18cf97da73a14717af9d81e57f2f4724"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "f5f9d5bcbe1c94da6deaf7a48092e10b"
server_key_iv: "a17ab7b88d9979c06ce3a6bffd697f2a"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.636042 19608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal/instance:
uuid: "18cf97da73a14717af9d81e57f2f4724"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "f5f9d5bcbe1c94da6deaf7a48092e10b"
server_key_iv: "a17ab7b88d9979c06ce3a6bffd697f2a"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.637296 19608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:44:43.637969 19623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.638151 19608 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:43.638243 19608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
uuid: "18cf97da73a14717af9d81e57f2f4724"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "f5f9d5bcbe1c94da6deaf7a48092e10b"
server_key_iv: "a17ab7b88d9979c06ce3a6bffd697f2a"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.638317 19608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.649003 19608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.651153 19608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:43.651302 19608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.655020 19608 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.124:38175
I20260619 02:44:43.655045 19675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.124:38175 every 8 connection(s)
I20260619 02:44:43.655365 19608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
I20260619 02:44:43.655910 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 19608
I20260619 02:44:43.656520 19676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:43.658849 19676 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.124@KRBTEST.COM
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.124@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:44:43.667007 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.659541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38026 (local address 127.12.145.126:44767)
0619 02:44:43.659586 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.659588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.659634 (+ 46us) server_negotiation.cc:407] Connection header received
0619 02:44:43.659716 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.659717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.659725 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.659779 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.660246 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.660860 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.661893 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.662082 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.662133 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.664296 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.664298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.664298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.664306 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.665798 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.666141 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.666142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.666142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.666191 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.666404 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.666405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.666406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.666524 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.666641 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.666835 (+ 194us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.666922 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:44:43.667035 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.659432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38026)
0619 02:44:43.659549 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.659585 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.659651 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.659794 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.659796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.660099 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.660171 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.660173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.660954 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.660954 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.661808 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.661811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.662184 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.662186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.662271 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.662759 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.662769 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.664182 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.665869 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.665875 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.665877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.666079 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.666267 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.666268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.666269 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.666331 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.666635 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.666641 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.666689 (+ 48us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.666791 (+ 102us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.666918 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":67,"threads_started":1}
I20260619 02:44:43.667042 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.656767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35748 (local address 127.12.145.124:38175)
0619 02:44:43.656933 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.656940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.656963 (+ 23us) server_negotiation.cc:407] Connection header received
0619 02:44:43.657524 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.657531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.657575 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.657680 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.658440 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.659582 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.660525 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.661092 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.661161 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.663691 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.663697 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.663698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.663705 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.665232 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.665593 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.665595 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.665596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.665671 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.666144 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.666144 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.666144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.666321 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.666465 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.666634 (+ 169us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.666802 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260619 02:44:43.667807 19676 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.124@KRBTEST.COM for oryx/127.12.145.125@KRBTEST.COM
I20260619 02:44:43.673863 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.668031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.0.0.1:37048)
0619 02:44:43.668076 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.668087 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.668122 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.668284 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.668285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.668411 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.668450 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.668452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.669088 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.669089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.669579 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.669581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.669963 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.669964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.670030 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.670421 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.670425 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.671577 (+ 1152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.672875 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.672876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.672876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.673041 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.673247 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.673248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.673248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.673302 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.673553 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.673554 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.673594 (+ 40us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.673681 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.673771 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260619 02:44:43.673871 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.668114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37048 (local address 127.12.145.125:44561)
0619 02:44:43.668162 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.668164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.668173 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:43.668198 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.668199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.668210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.668283 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.668533 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.669007 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.669671 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.669886 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.669954 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.671663 (+ 1709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.671664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.671665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.671672 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.672781 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.673123 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.673124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.673124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.673182 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.673374 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.673375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.673375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.673487 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.673563 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.673709 (+ 146us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.673787 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:44:43.674330 19676 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 38175 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.124@KRBTEST.COM for oryx/127.12.145.124@KRBTEST.COM
I20260619 02:44:43.679845 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.674585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.0.0.1:35764)
0619 02:44:43.674617 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.674628 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.674671 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.674780 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.674781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.674903 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.674947 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.674949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.675509 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.675510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.676082 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.676084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.676382 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.676382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.676417 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.676714 (+ 297us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.676717 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.677737 (+ 1020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.679142 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.679143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.679143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.679278 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.679427 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.679427 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.679428 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.679481 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.679637 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.679638 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.679666 (+ 28us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.679712 (+ 46us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.679777 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260619 02:44:43.679895 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.674615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35764 (local address 127.12.145.124:38175)
0619 02:44:43.674647 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.674649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.674659 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:44:43.674724 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.674725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.674731 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.674771 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.675019 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.675438 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.676154 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.676324 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.676371 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.677807 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.677808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.677809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.677814 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.679082 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.679334 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.679335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.679335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.679376 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.679519 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.679519 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.679519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.679592 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.679632 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.679725 (+ 93us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.679816 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":17}
I20260619 02:44:43.680979 19676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Bootstrap starting.
I20260619 02:44:43.681777 19676 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:43.682046 19676 log.cc:824] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:43.682751 19676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: No bootstrap required, opened a new log
I20260619 02:44:43.684161 19676 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 38175 } }
I20260619 02:44:43.684286 19676 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:43.684329 19676 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cf97da73a14717af9d81e57f2f4724, State: Initialized, Role: FOLLOWER
I20260619 02:44:43.684486 19676 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 38175 } }
I20260619 02:44:43.684713 19681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 38175 } } }
I20260619 02:44:43.684788 19676 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:43.684790 19681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [sys.catalog]: This master's current role is: FOLLOWER
W20260619 02:44:43.686362 19692 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:44:43.686416 19692 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:44:43.688385 19608 master_runner.cc:428] Detected that this master 18cf97da73a14717af9d81e57f2f4724 is joining an existing cluster
I20260619 02:44:43.688443 19608 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.145.124:38175
I20260619 02:44:43.695976 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.689760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35766 (local address 127.12.145.124:38175)
0619 02:44:43.689791 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.689793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.689885 (+ 92us) server_negotiation.cc:407] Connection header received
0619 02:44:43.689952 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.689953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.689962 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.690013 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.690421 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.691137 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692198 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.692468 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692526 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.693500 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.693501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.693501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.693508 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.694903 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.695256 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.695257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.695258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.695305 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.695567 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.695568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.695568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.695668 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.695716 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.695868 (+ 152us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.695925 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260619 02:44:43.696131 19698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.689618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.0.0.1:35766)
0619 02:44:43.689835 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.689844 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.689898 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.690063 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.690064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.690285 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.690351 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.690352 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.691222 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.691222 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.692121 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.692123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.692574 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.692642 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.693091 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.693096 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.693390 (+ 294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.695013 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.695013 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.695014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.695176 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.695379 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.695380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.695381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.695453 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.695733 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.695734 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.695775 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.695853 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.695995 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":46,"thread_start_us":73,"threads_started":1}
I20260619 02:44:43.714697 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.689517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37064 (local address 127.12.145.125:44561)
0619 02:44:43.689589 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.689591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.690057 (+ 466us) server_negotiation.cc:407] Connection header received
0619 02:44:43.690189 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.690190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.690200 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.690230 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.690629 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.691355 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692357 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.692677 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692718 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.711636 (+ 18918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.711638 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.711638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.711646 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.713304 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.713695 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.713696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.713697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.713756 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.714125 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.714126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.714127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.714267 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.714333 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.714495 (+ 162us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.714597 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 02:44:43.714738 19700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.689777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.0.0.1:37064)
0619 02:44:43.689986 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.689994 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.690113 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.690288 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.690289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.690452 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.690518 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.690519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.691431 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.691432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.692281 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.692282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.692793 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.692877 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.711183 (+ 18306us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.711188 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.711496 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.713410 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.713411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.713411 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.713586 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.713823 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.713823 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.713824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.713885 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.714332 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.714333 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.714390 (+ 57us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.714461 (+ 71us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.714607 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":63,"threads_started":1}
I20260619 02:44:43.715395 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.689475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38040 (local address 127.12.145.126:44767)
0619 02:44:43.689560 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.689562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.689817 (+ 255us) server_negotiation.cc:407] Connection header received
0619 02:44:43.689914 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.689915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.689924 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.689956 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.690397 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.691165 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692290 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.692582 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692642 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.712006 (+ 19364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.712008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.712008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.712017 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.713585 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.713980 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.713982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.713982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.714041 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.714231 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.714232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.714232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.714399 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.714472 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.715244 (+ 772us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.715334 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 02:44:43.715662 19699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.689381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38040)
0619 02:44:43.689753 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.689764 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.689842 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.690027 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.690028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.690236 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.690307 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.690308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.691278 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.691279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.692191 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.692193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.692715 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.692716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.692781 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.711538 (+ 18757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.711543 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.711908 (+ 365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.713678 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.713679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.713680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.713886 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.714106 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.714106 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.714106 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.714151 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.714616 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.714617 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.714656 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.715488 (+ 832us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.715596 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":2,"thread_start_us":96,"threads_started":1}
I20260619 02:44:43.718905 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 19016
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837081, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.126@KRBTEST.COM for oryx/127.12.145.124@KRBTEST.COM
I20260619 02:44:43.725062 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.717507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.0.0.1:35768)
0619 02:44:43.717563 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.717574 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.717613 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.717844 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.717844 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.718010 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.718062 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.718064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.718804 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.718805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.719675 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.719679 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.720186 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.720187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.720266 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.720644 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.720649 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.722204 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.723958 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.723959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.723959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.724195 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.724382 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.724383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.724384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.724450 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.724736 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.724736 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.724783 (+ 47us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.724854 (+ 71us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.724952 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260619 02:44:43.725106 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.717674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35768 (local address 127.12.145.124:38175)
0619 02:44:43.717723 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.717724 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.717731 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:44:43.717761 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.717761 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.717770 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.717839 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.718135 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.718665 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.719769 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.720071 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.720137 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.722288 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.722289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.722290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.722297 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.723867 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.724277 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.724278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.724278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.724330 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.724525 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.724526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.724526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.724665 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.724732 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.724889 (+ 157us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.724973 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260619 02:44:43.725531 18954 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.145.124:38175: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "18cf97da73a14717af9d81e57f2f4724"
member_type: NON_VOTER
last_known_addr {
host: "127.12.145.124"
port: 38175
}
attrs {
promote: true
}
}
dest_uuid: "3d3e97d189aa47f89e8ed33a531fb900"
cas_config_opid_index: 5
I20260619 02:44:43.725725 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:36107
--local_ip_for_outbound_sockets=127.12.145.65
--tserver_master_addrs=127.12.145.126:44767
--webserver_port=36877
--webserver_interface=127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab
--principal=oryx/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:44:43.725790 18954 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:43.726722 19515 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 18cf97da73a14717af9d81e57f2f4724 (127.12.145.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.727015 19650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:43.727634 19515 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.145.124:38175
I20260619 02:44:43.727695 19515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.727761 19515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:43.728065 19650 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 1 FOLLOWER]: Refusing update from remote peer 3d3e97d189aa47f89e8ed33a531fb900: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260619 02:44:43.728235 19608 master.cc:537] Master@127.12.145.124:38175 shutting down...
I20260619 02:44:43.728305 19516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 02:44:43.728932 18938 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 -> Peer 18cf97da73a14717af9d81e57f2f4724 (127.12.145.124:38175): Couldn't send request to peer 18cf97da73a14717af9d81e57f2f4724. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260619 02:44:43.731400 19608 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:43.731498 19608 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:43.731565 19608 tablet_replica.cc:330] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: stopping tablet replica
I20260619 02:44:43.732601 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.727947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.0.0.1:37078)
0619 02:44:43.728649 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.728659 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.728706 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.728905 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.728906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.728908 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:43.728945 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.728946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.729967 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.729978 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.731390 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.731392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.732367 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.732368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.732432 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.732454 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.732502 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.732535 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686}
I20260619 02:44:43.732890 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.728038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37078 (local address 127.12.145.125:44561)
0619 02:44:43.728618 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.728620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.728755 (+ 135us) server_negotiation.cc:407] Connection header received
0619 02:44:43.728778 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.728779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.728801 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.728850 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:43.729061 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.729819 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.731536 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.732108 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.732155 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.732218 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.732792 (+ 574us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.732830 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557}
I20260619 02:44:43.733549 19564 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 LEARNER]: Refusing update from remote peer 3d3e97d189aa47f89e8ed33a531fb900: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260619 02:44:43.733772 19516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260619 02:44:43.734349 19564 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 18cf97da73a14717af9d81e57f2f4724 (127.12.145.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.734530 19608 master.cc:552] Master@127.12.145.124:38175 shutdown complete.
I20260619 02:44:43.734705 19608 master_runner.cc:305] Clearing existing system tablet
I20260619 02:44:43.734850 19608 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.734894 19608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.735440 19593 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3e97d189aa47f89e8ed33a531fb900. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.735517 19593 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: This master's current role is: LEARNER
I20260619 02:44:43.735549 19593 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: NON_VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: true } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.735589 19593 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: This master's current role is: LEARNER
I20260619 02:44:43.735661 19608 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:43.736132 19706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.736213 19516 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: attempting to promote NON_VOTER c66bed1646e14da3b41d249045ef6aa3 to VOTER
I20260619 02:44:43.736243 19608 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.736287 19608 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.736308 19608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
uuid: "18cf97da73a14717af9d81e57f2f4724"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "f5f9d5bcbe1c94da6deaf7a48092e10b"
server_key_iv: "a17ab7b88d9979c06ce3a6bffd697f2a"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.736402 19516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:43.737149 19564 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 LEARNER]: Refusing update from remote peer 3d3e97d189aa47f89e8ed33a531fb900: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260619 02:44:43.737241 19608 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:43.737337 19515 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260619 02:44:43.737756 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.736876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.0.0.1:35782)
0619 02:44:43.737691 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.737731 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:38175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":800}
I20260619 02:44:43.738092 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.737989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.0.0.1:35798)
0619 02:44:43.738049 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.738070 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:38175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 02:44:43.738209 18938 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 -> Peer 18cf97da73a14717af9d81e57f2f4724 (127.12.145.124:38175): Couldn't send request to peer 18cf97da73a14717af9d81e57f2f4724. Status: Network error: Client connection negotiation failed: client connection to 127.12.145.124:38175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 02:44:43.738583 19515 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c66bed1646e14da3b41d249045ef6aa3 (127.12.145.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.738758 19608 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260619 02:44:43.738826 19608 log.cc:1196] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260619 02:44:43.739020 19608 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Deleting consensus metadata
I20260619 02:44:43.739176 19608 master_runner.cc:315] Copying system tablet from 127.12.145.126:44767
I20260619 02:44:43.739387 19515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.739467 19515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:43.739529 19515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.739579 19515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900 [sys.catalog]: This master's current role is: LEADER
I20260619 02:44:43.739789 19564 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c66bed1646e14da3b41d249045ef6aa3 (127.12.145.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.739966 19608 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: tablet copy: Beginning tablet copy session from remote peer at address 127.12.145.126:44767
I20260619 02:44:43.740700 19704 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d3e97d189aa47f89e8ed33a531fb900" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.740782 19704 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:44:43.749477 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.742811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38056 (local address 127.12.145.126:44767)
0619 02:44:43.742860 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.742862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.742996 (+ 134us) server_negotiation.cc:407] Connection header received
0619 02:44:43.743048 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.743049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.743059 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.743115 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.743435 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.744210 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.745221 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.745548 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.745615 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.746696 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.746697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.746697 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.746705 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.748287 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.748668 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.748669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.748669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.748726 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.748924 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.748925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.748925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.749053 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.749118 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.749312 (+ 194us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.749387 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260619 02:44:43.749962 19712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.742755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38056)
0619 02:44:43.742917 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.742927 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.742998 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.743119 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.743120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.743312 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.743379 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.743381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.744286 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.744287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.745130 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.745132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.745626 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.745627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.745686 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.746196 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.746202 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.746624 (+ 422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.748369 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.748370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.748370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.748591 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.748794 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.748794 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.748795 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.748859 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.749147 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.749148 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.749201 (+ 53us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.749737 (+ 536us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.749843 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260619 02:44:43.750468 18974 tablet_copy_service.cc:140] P 3d3e97d189aa47f89e8ed33a531fb900: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 18cf97da73a14717af9d81e57f2f4724 ({username='oryx', principal='oryx/127.12.145.124@KRBTEST.COM'} at 127.0.0.1:38056)
I20260619 02:44:43.750527 18974 tablet_copy_service.cc:161] P 3d3e97d189aa47f89e8ed33a531fb900: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 18cf97da73a14717af9d81e57f2f4724 at {username='oryx', principal='oryx/127.12.145.124@KRBTEST.COM'} at 127.0.0.1:38056: session id = 18cf97da73a14717af9d81e57f2f4724-00000000000000000000000000000000
I20260619 02:44:43.751075 18974 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 02:44:43.751578 19608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260619 02:44:43.752736 19608 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: tablet copy: Starting download of 0 data blocks...
I20260619 02:44:43.752858 19608 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: tablet copy: Starting download of 1 WAL segments...
I20260619 02:44:43.753594 19608 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 02:44:43.754391 18974 tablet_copy_service.cc:342] P 3d3e97d189aa47f89e8ed33a531fb900: Request end of tablet copy session 18cf97da73a14717af9d81e57f2f4724-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.145.124@KRBTEST.COM'} at 127.0.0.1:38056
I20260619 02:44:43.754436 18974 tablet_copy_service.cc:433] P 3d3e97d189aa47f89e8ed33a531fb900: ending tablet copy session 18cf97da73a14717af9d81e57f2f4724-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 18cf97da73a14717af9d81e57f2f4724
I20260619 02:44:43.756801 19608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.757884 19713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.757884 19716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.758073 19608 server_base.cc:1034] running on GCE node
W20260619 02:44:43.758340 19714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.758515 19608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.758688 19608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.759825 19608 hybrid_clock.cc:648] HybridClock initialized: now 1781837083759811 us; error 28 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.761240 19608 init.cc:377] Logged in from keytab as oryx/127.12.145.124@KRBTEST.COM (short username oryx)
I20260619 02:44:43.761492 19608 webserver.cc:460] Webserver started at http://127.12.145.124:34407/ using document root <none> and password file <none>
I20260619 02:44:43.761610 19608 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.761633 19608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.762275 19608 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:44:43.762851 19723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.762960 19608 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.763005 19608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
uuid: "18cf97da73a14717af9d81e57f2f4724"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "f5f9d5bcbe1c94da6deaf7a48092e10b"
server_key_iv: "a17ab7b88d9979c06ce3a6bffd697f2a"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.763059 19608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.774724 19608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.776446 19608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.779453 19608 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.124:38175
I20260619 02:44:43.779687 19775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.124:38175 every 8 connection(s)
I20260619 02:44:43.779829 19608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
I20260619 02:44:43.783340 19776 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:44:43.783854 19776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Bootstrap starting.
I20260619 02:44:43.786952 19776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:44:43.787207 19776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: Bootstrap complete.
I20260619 02:44:43.787398 19776 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:43.787492 19776 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 18cf97da73a14717af9d81e57f2f4724, State: Initialized, Role: LEARNER
I20260619 02:44:43.787531 19776 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:43.787696 19776 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:44:43.787703 19779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } } }
I20260619 02:44:43.787905 19779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724 [sys.catalog]: This master's current role is: LEARNER
I20260619 02:44:43.789460 19790 catalog_manager.cc:1259] Loaded cluster ID: 24794ed8efcd42c89ccd3efa0c103bb4
I20260619 02:44:43.789543 19790 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: loading cluster ID for follower catalog manager: success
I20260619 02:44:43.790724 19790 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: acquiring CA information for follower catalog manager: success
I20260619 02:44:43.791049 19790 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 18cf97da73a14717af9d81e57f2f4724: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 02:44:43.822618 19702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:43.822818 19702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:43.822852 19702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:43.823983 19702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:43.824051 19702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:43.824095 19702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:44:43.825554 19702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab
--principal=oryx/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:36107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=36877
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:43.825810 19702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:43.826031 19702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.831661 19796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.831668 19798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.831899 19702 server_base.cc:1034] running on GCE node
W20260619 02:44:43.831672 19795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.832201 19702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.832439 19702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.833607 19702 hybrid_clock.cc:648] HybridClock initialized: now 1781837083833595 us; error 33 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.836073 19702 init.cc:377] Logged in from keytab as oryx/127.12.145.65@KRBTEST.COM (short username oryx)
I20260619 02:44:43.836472 19702 webserver.cc:460] Webserver started at http://127.12.145.65:36877/ using document root <none> and password file <none>
I20260619 02:44:43.836711 19702 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.836793 19702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.838184 19702 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:43.838819 19805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.838984 19702 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:44:43.839082 19702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "c34c166ec3324133846339e755ffc4eb"
format_stamp: "Formatted at 2026-06-19 02:44:42 on dist-test-slave-fbl4"
server_key: "4626c0b4fe39bc04131a9425391bcb6a"
server_key_iv: "6f9a9e72ed38ac349408e813087a2a15"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.839401 19702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.860091 19702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.861852 19702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:43.862005 19702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.862237 19702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:43.862521 19702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:43.862602 19702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.862715 19702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:43.862782 19702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.868880 19702 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:36107
I20260619 02:44:43.868927 19918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:36107 every 8 connection(s)
I20260619 02:44:43.869238 19702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:44:43.871163 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 19702
I20260619 02:44:43.871337 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 19151
I20260619 02:44:43.877178 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:34161
--local_ip_for_outbound_sockets=127.12.145.66
--tserver_master_addrs=127.12.145.126:44767
--webserver_port=38445
--webserver_interface=127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab
--principal=oryx/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.125@KRBTEST.COM
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.124@KRBTEST.COM
I20260619 02:44:43.882210 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.869930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:60147 (local address 127.12.145.125:44561)
0619 02:44:43.870000 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.870002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.870207 (+ 205us) server_negotiation.cc:407] Connection header received
0619 02:44:43.871356 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.871357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.871371 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.871404 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.872433 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.873199 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.874793 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.875099 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.875140 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.878297 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.878299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.878299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.878306 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.880908 (+ 2602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881370 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.881371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.881371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.881424 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881616 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.881616 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.881617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.881747 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.881788 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.882043 (+ 255us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.882117 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:44:43.882210 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.870510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:39491 (local address 127.12.145.126:44767)
0619 02:44:43.870597 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.870600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.870706 (+ 106us) server_negotiation.cc:407] Connection header received
0619 02:44:43.871377 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.871379 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.871390 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.871420 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.872433 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.873199 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.874799 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.875099 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.875140 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.878846 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.878847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.878848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.878855 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.880620 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881131 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.881132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.881132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.881188 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881465 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.881466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.881466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.881618 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.881673 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.882036 (+ 363us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.882117 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:44:43.882302 19926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.870518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:50177 (local address 127.12.145.124:38175)
0619 02:44:43.870639 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.870642 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.870651 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:43.871394 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:43.871396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:43.872857 (+ 1461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:43.873326 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:43.873367 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.874540 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.875705 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.876078 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.876370 (+ 292us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.878839 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:43.878840 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:43.878841 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:43.878848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:43.880840 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881375 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.881376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.881377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.881438 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881664 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:43.881665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:43.881665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:43.881807 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:43.881853 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:43.882070 (+ 217us) server_negotiation.cc:299] Negotiation successful
0619 02:44:43.882163 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260619 02:44:43.882839 19925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.870413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:39491)
0619 02:44:43.870630 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.870640 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.871283 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.871596 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.871600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.872018 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.872326 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.872332 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.873333 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.873333 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.874690 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.874692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.875226 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.875227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.875369 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.875980 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.875989 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.878753 (+ 2764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.880713 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.880719 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.880721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.881048 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.881259 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.881261 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.881387 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.881704 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.881709 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.881863 (+ 154us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.882328 (+ 465us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.882582 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":63,"thread_start_us":53,"threads_started":1}
I20260619 02:44:43.882846 19924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.870215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.12.145.65:50177)
0619 02:44:43.870336 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.870346 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.871248 (+ 902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.872982 (+ 1734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.872983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.873176 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.873245 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.873247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.874661 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.874662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.875611 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.875613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.876163 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.876164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.876233 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.876918 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.876923 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.878732 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.880937 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.880938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.880938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.881282 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.881522 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881522 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.881523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.881587 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.881904 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.881905 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.881949 (+ 44us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.882381 (+ 432us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.882665 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":141,"thread_start_us":70,"threads_started":1}
I20260619 02:44:43.883380 19920 heartbeater.cc:347] Connected to a master server at 127.12.145.126:44767
I20260619 02:44:43.883496 19920 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:43.883591 19919 heartbeater.cc:347] Connected to a master server at 127.12.145.124:38175
I20260619 02:44:43.883659 19919 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:43.883692 19920 heartbeater.cc:511] Master 127.12.145.126:44767 requested a full tablet report, sending...
I20260619 02:44:43.883600 19923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.869935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.12.145.65:60147)
0619 02:44:43.870084 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.870117 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:43.871233 (+ 1116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:43.871955 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:43.871955 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:43.872127 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:43.872326 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.872332 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.873333 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.873333 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.874690 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:43.874692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:43.875228 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:43.875228 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:43.875369 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:43.876094 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:43.876099 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:43.878192 (+ 2093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:43.881008 (+ 2816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.881009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.881293 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.881499 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:43.881500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:43.881500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:43.881548 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:43.881830 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:43.881831 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:43.881863 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 02:44:43.882875 (+ 1012us) client_negotiation.cc:240] Negotiation successful
0619 02:44:43.883347 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":51,"thread_start_us":84,"threads_started":1}
I20260619 02:44:43.883750 19919 heartbeater.cc:511] Master 127.12.145.124:38175 requested a full tablet report, sending...
I20260619 02:44:43.884114 18954 ts_manager.cc:194] Re-registered known tserver with Master: c34c166ec3324133846339e755ffc4eb (127.12.145.65:36107)
I20260619 02:44:43.884276 19921 heartbeater.cc:347] Connected to a master server at 127.12.145.125:44561
I20260619 02:44:43.884312 19921 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:43.884356 19740 ts_manager.cc:194] Registered new tserver with Master: c34c166ec3324133846339e755ffc4eb (127.12.145.65:36107)
I20260619 02:44:43.884392 19921 heartbeater.cc:511] Master 127.12.145.125:44561 requested a full tablet report, sending...
I20260619 02:44:43.884603 18954 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:39491
I20260619 02:44:43.884727 19554 ts_manager.cc:194] Registered new tserver with Master: c34c166ec3324133846339e755ffc4eb (127.12.145.65:36107)
W20260619 02:44:43.958344 19927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:43.958530 19927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:43.958602 19927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:43.959753 19927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:43.959793 19927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:43.959844 19927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:44:43.961272 19927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab
--principal=oryx/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:34161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=38445
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:43.961498 19927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:43.961730 19927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:43.966854 19933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:43.966866 19935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.966895 19927 server_base.cc:1034] running on GCE node
W20260619 02:44:43.966871 19932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:43.967259 19927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:43.967470 19927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:43.968616 19927 hybrid_clock.cc:648] HybridClock initialized: now 1781837083968602 us; error 31 us; skew 500 ppm
Jun 19 02:44:43 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:43.970892 19927 init.cc:377] Logged in from keytab as oryx/127.12.145.66@KRBTEST.COM (short username oryx)
I20260619 02:44:43.971298 19927 webserver.cc:460] Webserver started at http://127.12.145.66:38445/ using document root <none> and password file <none>
I20260619 02:44:43.971520 19927 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:43.971608 19927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:43.972790 19927 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:43.973299 19942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.973492 19927 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.973558 19927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "d58e5113dac04d62981bddf7b753a2a0"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "fceac28b538e2494160c6e36f4a1dcab"
server_key_iv: "d4e77e356c6f2c118271bf9b96af5b90"
server_key_version: "encryptionkey@0"
I20260619 02:44:43.973825 19927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:43.989485 19927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:43.991593 19927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:43.991696 19927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:43.991905 19927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:43.992200 19927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:43.992259 19927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.992301 19927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:43.992326 19927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:43.997766 19927 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34161
I20260619 02:44:43.997844 20055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34161 every 8 connection(s)
I20260619 02:44:43.998198 19927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:44:44.002102 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 19927
I20260619 02:44:44.002255 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 19285
Jun 19 02:44:44 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.124@KRBTEST.COM
Jun 19 02:44:44 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
Jun 19 02:44:44 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837083, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.125@KRBTEST.COM
I20260619 02:44:44.009703 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:41189
--local_ip_for_outbound_sockets=127.12.145.67
--tserver_master_addrs=127.12.145.126:44767
--webserver_port=41749
--webserver_interface=127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab
--principal=oryx/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:44:44.010775 19926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.998915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:42753 (local address 127.12.145.124:38175)
0619 02:44:43.998958 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.998960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.999182 (+ 222us) server_negotiation.cc:407] Connection header received
0619 02:44:44.000372 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.000374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.000389 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.000419 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.001215 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.001964 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003383 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.003687 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003726 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.007361 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.007363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.007364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.007371 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.009230 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009642 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.009643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.009643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.009695 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009995 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.009996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.009996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.010127 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.010171 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.010578 (+ 407us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.010682 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:44:44.010898 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.999308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:51137 (local address 127.12.145.126:44767)
0619 02:44:43.999372 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.999375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.999589 (+ 214us) server_negotiation.cc:407] Connection header received
0619 02:44:44.000372 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.000374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.000386 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.000419 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.001213 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.001972 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003330 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.003641 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003681 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.007069 (+ 3388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.007070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.007071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.007078 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.009056 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009627 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.009629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.009629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.009687 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009995 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.009996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.009996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.010127 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.010171 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.010726 (+ 555us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.010799 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:44:44.011348 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.999148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:51137)
0619 02:44:43.999511 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.999521 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.000263 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.000512 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.000517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.000931 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:44.001108 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.001113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.002063 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.002063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.003228 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.003230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.003768 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.003901 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.004576 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:44.004589 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:44.006904 (+ 2315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:44.009149 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.009158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.009536 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.009765 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009765 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.009766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.009914 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.010222 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:44.010228 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:44.010384 (+ 156us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.010970 (+ 586us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.011160 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":155,"thread_start_us":65,"threads_started":1}
I20260619 02:44:44.011348 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.998852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.12.145.66:42753)
0619 02:44:43.999029 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.999068 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.000253 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.000512 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.000517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.000926 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:44.001108 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.001113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.002063 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.002063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.003296 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.003299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.003795 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003795 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.003901 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.004620 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:44.004624 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:44.007256 (+ 2632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:44.009305 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009305 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.009306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.009564 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.009765 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.009765 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.009766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.009914 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.010222 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:44.010228 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:44.010384 (+ 156us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.010897 (+ 513us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.011094 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":309,"thread_start_us":94,"threads_started":1}
I20260619 02:44:44.012099 20056 heartbeater.cc:347] Connected to a master server at 127.12.145.124:38175
I20260619 02:44:44.012207 20056 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:44.012287 20057 heartbeater.cc:347] Connected to a master server at 127.12.145.126:44767
I20260619 02:44:44.012351 20057 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:44.012377 20056 heartbeater.cc:511] Master 127.12.145.124:38175 requested a full tablet report, sending...
I20260619 02:44:44.012415 20057 heartbeater.cc:511] Master 127.12.145.126:44767 requested a full tablet report, sending...
I20260619 02:44:44.012789 19740 ts_manager.cc:194] Registered new tserver with Master: d58e5113dac04d62981bddf7b753a2a0 (127.12.145.66:34161)
I20260619 02:44:44.012933 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.998912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:48121 (local address 127.12.145.125:44561)
0619 02:44:43.999127 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:43.999129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:43.999476 (+ 347us) server_negotiation.cc:407] Connection header received
0619 02:44:44.000356 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.000357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.000369 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.000416 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.001207 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.001686 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003508 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.003853 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003897 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.007566 (+ 3669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.007567 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.007568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.007575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.009878 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.010464 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.010465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.010466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.010536 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.010762 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.010763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.010764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.010909 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.010956 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.012772 (+ 1816us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.012854 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260619 02:44:44.012938 18954 ts_manager.cc:194] Re-registered known tserver with Master: d58e5113dac04d62981bddf7b753a2a0 (127.12.145.66:34161)
I20260619 02:44:44.013255 20060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:43.998852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.12.145.66:48121)
0619 02:44:43.999408 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:43.999418 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.000254 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.000514 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.000517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.000902 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:44.001106 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.001110 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.001785 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.001786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.003394 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.003397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.003976 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.003977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.004047 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.004960 (+ 913us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:44.004965 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:44.007442 (+ 2477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:44.010183 (+ 2741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.010184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.010184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.010403 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.010613 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.010614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.010615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.010680 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.012591 (+ 1911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:44.012592 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:44.012644 (+ 52us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.012737 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.012894 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":257,"thread_start_us":93,"threads_started":1}
I20260619 02:44:44.013284 18954 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:51137
I20260619 02:44:44.013988 20058 heartbeater.cc:347] Connected to a master server at 127.12.145.125:44561
I20260619 02:44:44.014032 20058 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:44.014065 20058 heartbeater.cc:511] Master 127.12.145.125:44561 requested a full tablet report, sending...
I20260619 02:44:44.014379 19554 ts_manager.cc:194] Registered new tserver with Master: d58e5113dac04d62981bddf7b753a2a0 (127.12.145.66:34161)
W20260619 02:44:44.090790 20063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:44:44.090963 20063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:44:44.090993 20063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:44:44.092041 20063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:44:44.092072 20063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:44:44.092097 20063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:44:44.093441 20063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab
--principal=oryx/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:41189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=41749
--tserver_master_addrs=127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:44:44.093598 20063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:44:44.093746 20063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:44:44.098253 20068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:44.098358 20063 server_base.cc:1034] running on GCE node
W20260619 02:44:44.098278 20071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:44:44.098395 20069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:44:44.098701 20063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:44:44.098946 20063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:44:44.100143 20063 hybrid_clock.cc:648] HybridClock initialized: now 1781837084100120 us; error 33 us; skew 500 ppm
Jun 19 02:44:44 dist-test-slave-fbl4 krb5kdc[18909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837084, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:44:44.102717 20063 init.cc:377] Logged in from keytab as oryx/127.12.145.67@KRBTEST.COM (short username oryx)
I20260619 02:44:44.103117 20063 webserver.cc:460] Webserver started at http://127.12.145.67:41749/ using document root <none> and password file <none>
I20260619 02:44:44.103291 20063 fs_manager.cc:359] Metadata directory not provided
I20260619 02:44:44.103339 20063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:44:44.104626 20063 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:44.105258 20078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:44.105472 20063 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:44:44.105544 20063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "a3cd3061e2d844ad9fd4c31a045d2308"
format_stamp: "Formatted at 2026-06-19 02:44:43 on dist-test-slave-fbl4"
server_key: "bdd0aa67c6f00cadde2a64b0b57e520f"
server_key_iv: "f5fc3dd9e9d487d75d3452bbac735bc8"
server_key_version: "encryptionkey@0"
I20260619 02:44:44.105937 20063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:44:44.118929 20063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:44:44.120750 20063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:44:44.120888 20063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:44:44.121132 20063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:44:44.121440 20063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:44:44.121474 20063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:44.121496 20063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:44:44.121541 20063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:44:44.127101 20063 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:41189
I20260619 02:44:44.127140 20191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:41189 every 8 connection(s)
I20260619 02:44:44.127445 20063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:44:44 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837084, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
Jun 19 02:44:44 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837084, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.125@KRBTEST.COM
Jun 19 02:44:44 dist-test-slave-fbl4 krb5kdc[18909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837084, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.124@KRBTEST.COM
I20260619 02:44:44.135519 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 20063
I20260619 02:44:44.139122 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.128084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:39683 (local address 127.12.145.125:44561)
0619 02:44:44.128129 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.128131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.128390 (+ 259us) server_negotiation.cc:407] Connection header received
0619 02:44:44.128960 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.128962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.128975 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.129007 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.129918 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.130707 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.132159 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.132339 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.132466 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.135717 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.135718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.135719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.135727 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.137616 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.137983 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.137985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.137985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.138041 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.138324 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.138325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.138325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.138470 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.138523 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.138935 (+ 412us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.139014 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:44:44.139600 19926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.128422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:42353 (local address 127.12.145.124:38175)
0619 02:44:44.128477 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.128479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.128531 (+ 52us) server_negotiation.cc:407] Connection header received
0619 02:44:44.128940 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.128941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.128953 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.128992 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.129912 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.130380 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.131735 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.132048 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.132113 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.135756 (+ 3643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.135757 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.135757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.135765 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.138440 (+ 2675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.138808 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.138809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.138809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.138878 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.139066 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.139067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.139068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.139187 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.139246 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.139446 (+ 200us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.139516 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260619 02:44:44.139667 20196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.128089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:44561 (local address 127.12.145.67:39683)
0619 02:44:44.128260 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.128304 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.128839 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.129087 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.129091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.129587 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:44.129813 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.129819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.130763 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.130763 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.131670 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.131672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.132814 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.132815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.132874 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.133280 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:44.133285 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:44.135614 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:44.137699 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.137700 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.137700 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.137899 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.138112 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.138112 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.138113 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.138239 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.138600 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:44.138606 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:44.138757 (+ 151us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.139251 (+ 494us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.139444 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":12,"thread_start_us":87,"threads_started":1}
I20260619 02:44:44.139997 20198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.128358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:38175 (local address 127.12.145.67:42353)
0619 02:44:44.128476 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.128486 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.128853 (+ 367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.129340 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.129340 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.129594 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:44.129813 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.129817 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.130481 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.130482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.131661 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.131663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.132120 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.132121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.132175 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.132830 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:44.132834 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:44.135648 (+ 2814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:44.138521 (+ 2873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.138522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.138522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.138729 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.138945 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.138946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.138946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.139002 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.139271 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:44.139272 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:44.139310 (+ 38us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.139362 (+ 52us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.139884 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":322,"thread_start_us":53,"threads_started":1}
I20260619 02:44:44.140588 20192 heartbeater.cc:347] Connected to a master server at 127.12.145.124:38175
I20260619 02:44:44.140671 20192 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:44.140841 20192 heartbeater.cc:511] Master 127.12.145.124:38175 requested a full tablet report, sending...
I20260619 02:44:44.141245 19740 ts_manager.cc:194] Registered new tserver with Master: a3cd3061e2d844ad9fd4c31a045d2308 (127.12.145.67:41189)
I20260619 02:44:44.141520 20194 heartbeater.cc:347] Connected to a master server at 127.12.145.125:44561
I20260619 02:44:44.141566 20194 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:44.141621 20194 heartbeater.cc:511] Master 127.12.145.125:44561 requested a full tablet report, sending...
I20260619 02:44:44.141656 20197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.128089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:56539)
0619 02:44:44.128260 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.128304 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.128839 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.129087 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.129091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.129592 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:44:44.129813 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.129819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.130765 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.130766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.131528 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.131530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.132037 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.132038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.132174 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.132777 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:44:44.132802 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:44:44.134520 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:44:44.137381 (+ 2861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.137387 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.137390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.137674 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.140398 (+ 2724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:44:44.140399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:44:44.140400 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:44:44.140475 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:44:44.140782 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:44:44.140783 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:44:44.140821 (+ 38us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.140884 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.140997 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":5,"spinlock_wait_cycles":8576,"thread_start_us":92,"threads_started":1}
I20260619 02:44:44.141867 19554 ts_manager.cc:194] Registered new tserver with Master: a3cd3061e2d844ad9fd4c31a045d2308 (127.12.145.67:41189)
I20260619 02:44:44.142068 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.128083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:56539 (local address 127.12.145.126:44767)
0619 02:44:44.128129 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.128131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.128389 (+ 258us) server_negotiation.cc:407] Connection header received
0619 02:44:44.128962 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.128963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.128975 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.129007 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.129931 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.130676 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.131653 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.131957 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.132023 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.134641 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.134642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.134642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.134651 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.137287 (+ 2636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.140253 (+ 2966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.140254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.140254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.140319 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.140546 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.140547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.140547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.140674 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.140735 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.141892 (+ 1157us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.141990 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:44:44.142522 20193 heartbeater.cc:347] Connected to a master server at 127.12.145.126:44767
I20260619 02:44:44.142594 20193 heartbeater.cc:464] Registering TS with master...
I20260619 02:44:44.142664 20193 heartbeater.cc:511] Master 127.12.145.126:44767 requested a full tablet report, sending...
I20260619 02:44:44.142942 18954 ts_manager.cc:194] Re-registered known tserver with Master: a3cd3061e2d844ad9fd4c31a045d2308 (127.12.145.67:41189)
I20260619 02:44:44.143422 18954 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:56539
I20260619 02:44:44.146529 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.136952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35808 (local address 127.12.145.124:38175)
0619 02:44:44.137230 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.137232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.137238 (+ 6us) server_negotiation.cc:407] Connection header received
0619 02:44:44.137263 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.137264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.137272 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.137347 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.138612 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.139316 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.140541 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.140847 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.140881 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.143019 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.143020 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.143021 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.143028 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.144861 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.145570 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.145571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.145571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.145626 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.145840 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.145841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.145841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.145984 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.146057 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.146316 (+ 259us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.146412 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":74,"threads_started":1}
I20260619 02:44:44.149308 20204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.136748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38064 (local address 127.12.145.126:44767)
0619 02:44:44.137425 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.137426 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.137433 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:44:44.137453 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.137454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.137467 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.137541 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.138270 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.139053 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.142488 (+ 3435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.142871 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.142949 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.144222 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.144223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.144224 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.144232 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.146022 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.148541 (+ 2519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.148542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.148543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.148597 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.148810 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.148812 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.148812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.148924 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.149037 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.149169 (+ 132us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.149249 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":86,"threads_started":1}
I20260619 02:44:44.150247 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.136789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37092 (local address 127.12.145.125:44561)
0619 02:44:44.137024 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.137027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.137658 (+ 631us) server_negotiation.cc:407] Connection header received
0619 02:44:44.137755 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.137756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.137769 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.137808 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.144186 (+ 6378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.144672 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.145634 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.145889 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.145930 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.147516 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.147517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.147518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.147523 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.149054 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.149450 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.149452 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.149452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.149505 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.149682 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.149684 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.149684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.149813 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.149916 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.150053 (+ 137us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.150136 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":53,"threads_started":1}
I20260619 02:44:44.150866 18954 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:44:44.152361 18954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:44:44.159303 20215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.155996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50826 (local address 127.12.145.66:34161)
0619 02:44:44.156241 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.156246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.156280 (+ 34us) server_negotiation.cc:407] Connection header received
0619 02:44:44.156387 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.156390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.156405 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.156473 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:44.156635 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.157279 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.158271 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.158953 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.159045 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.159122 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.159189 (+ 67us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.159228 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":77,"threads_started":1}
I20260619 02:44:44.159327 20216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.155904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34161 (local address 127.0.0.1:50826)
0619 02:44:44.156230 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.156239 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.156286 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.156540 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.156541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.156543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:44.156573 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.156574 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.157381 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.157382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.158124 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.158126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.159047 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.159048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.159110 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.159114 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.159175 (+ 61us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.159215 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":93,"threads_started":1}
I20260619 02:44:44.159835 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.155808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:36107 (local address 127.0.0.1:34038)
0619 02:44:44.155860 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.155870 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.155908 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.156257 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.156258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.156259 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:44.156300 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.156302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.157616 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.157617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.158702 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.158704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.159654 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.159655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.159713 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.159716 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.159745 (+ 29us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.159779 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260619 02:44:44.160048 19990 tablet_service.cc:1467] Processing CreateTablet for tablet b6b2da67186a43e1a711bc730c85d527 (DEFAULT_TABLE table=test-table [id=7e644912bf5241e6928a9a77bc9c2443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:44.160157 20213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.155901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34038 (local address 127.12.145.65:36107)
0619 02:44:44.156069 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.156074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.156084 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:44:44.156125 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.156129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.156146 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.156371 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:44.156436 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.157525 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.158792 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.159563 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.159954 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.160020 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.160045 (+ 25us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.160083 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260619 02:44:44.160431 19990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6b2da67186a43e1a711bc730c85d527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:44.160857 20214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.156085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:41189 (local address 127.0.0.1:48022)
0619 02:44:44.156672 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.156681 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.156717 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.156959 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.156960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.156961 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:44.157006 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.157007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.158174 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.158175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.159263 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.159266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.160654 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.160655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.160712 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.160716 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.160745 (+ 29us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.160780 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":66,"threads_started":1}
I20260619 02:44:44.160840 19853 tablet_service.cc:1467] Processing CreateTablet for tablet b6b2da67186a43e1a711bc730c85d527 (DEFAULT_TABLE table=test-table [id=7e644912bf5241e6928a9a77bc9c2443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:44.161222 19853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6b2da67186a43e1a711bc730c85d527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:44.161388 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.156156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48022 (local address 127.12.145.67:41189)
0619 02:44:44.156818 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.156822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.156831 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:44:44.156862 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.156864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.156878 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.157070 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:44.157113 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.158085 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.159621 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.160559 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.161131 (+ 572us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.161207 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.161233 (+ 26us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.161310 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":69,"threads_started":1}
I20260619 02:44:44.162016 20126 tablet_service.cc:1467] Processing CreateTablet for tablet b6b2da67186a43e1a711bc730c85d527 (DEFAULT_TABLE table=test-table [id=7e644912bf5241e6928a9a77bc9c2443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:44:44.162313 20126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6b2da67186a43e1a711bc730c85d527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:44:44.164347 20218 tablet_bootstrap.cc:492] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Bootstrap starting.
I20260619 02:44:44.164680 20219 tablet_bootstrap.cc:492] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Bootstrap starting.
I20260619 02:44:44.165068 20218 tablet_bootstrap.cc:654] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:44.165292 20219 tablet_bootstrap.cc:654] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:44.165458 20218 log.cc:824] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:44.165606 20219 log.cc:824] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:44.166178 20220 tablet_bootstrap.cc:492] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Bootstrap starting.
I20260619 02:44:44.166339 20219 tablet_bootstrap.cc:492] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: No bootstrap required, opened a new log
I20260619 02:44:44.166361 20218 tablet_bootstrap.cc:492] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: No bootstrap required, opened a new log
I20260619 02:44:44.166409 20219 ts_tablet_manager.cc:1397] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:44.166429 20218 ts_tablet_manager.cc:1397] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:44.166858 20220 tablet_bootstrap.cc:654] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Neither blocks nor log segments found. Creating new log.
I20260619 02:44:44.167157 20220 log.cc:824] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Log is configured to *not* fsync() on all Append() calls
I20260619 02:44:44.167917 20220 tablet_bootstrap.cc:492] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: No bootstrap required, opened a new log
I20260619 02:44:44.167997 20220 ts_tablet_manager.cc:1397] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:44:44.168531 20219 raft_consensus.cc:348] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.168699 20219 raft_consensus.cc:374] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:44.168735 20219 raft_consensus.cc:729] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58e5113dac04d62981bddf7b753a2a0, State: Initialized, Role: FOLLOWER
I20260619 02:44:44.168875 20219 consensus_queue.cc:260] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.168850 20218 raft_consensus.cc:348] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.169114 20219 ts_tablet_manager.cc:1428] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:44:44.169167 20218 raft_consensus.cc:374] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:44.169230 20218 raft_consensus.cc:729] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c34c166ec3324133846339e755ffc4eb, State: Initialized, Role: FOLLOWER
I20260619 02:44:44.169349 20218 consensus_queue.cc:260] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.169436 20057 heartbeater.cc:503] Master 127.12.145.126:44767 was elected leader, sending a full tablet report...
I20260619 02:44:44.169587 20218 ts_tablet_manager.cc:1428] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:44:44.169690 19920 heartbeater.cc:503] Master 127.12.145.126:44767 was elected leader, sending a full tablet report...
I20260619 02:44:44.170533 20220 raft_consensus.cc:348] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.170713 20220 raft_consensus.cc:374] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:44:44.170753 20220 raft_consensus.cc:729] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3cd3061e2d844ad9fd4c31a045d2308, State: Initialized, Role: FOLLOWER
I20260619 02:44:44.170866 20220 consensus_queue.cc:260] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.171129 20193 heartbeater.cc:503] Master 127.12.145.126:44767 was elected leader, sending a full tablet report...
I20260619 02:44:44.171432 20220 ts_tablet_manager.cc:1428] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260619 02:44:44.197389 20224 raft_consensus.cc:482] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:44:44.197481 20224 raft_consensus.cc:504] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.197764 20224 leader_election.cc:288] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c34c166ec3324133846339e755ffc4eb (127.12.145.65:36107), a3cd3061e2d844ad9fd4c31a045d2308 (127.12.145.67:41189)
I20260619 02:44:44.200667 20217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.198133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:51443 (local address 127.12.145.67:41189)
0619 02:44:44.198174 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.198180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.198187 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:44:44.198226 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.198227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.198236 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.198288 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:44.198455 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.198950 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.199928 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.200322 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.200378 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.200385 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.200559 (+ 174us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.200604 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:44:44.200668 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.198054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:41189 (local address 127.12.145.66:51443)
0619 02:44:44.198097 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.198107 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.198145 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.198311 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.198312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.198313 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:44.198386 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.198388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.199054 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.199055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.199841 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.199844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.200404 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.200405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.200478 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.200481 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.200536 (+ 55us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.200566 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":16}
I20260619 02:44:44.200729 20213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.198068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:56037 (local address 127.12.145.65:36107)
0619 02:44:44.198116 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.198118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.198126 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:44:44.198153 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.198154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.198163 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.198219 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:44:44.198395 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.198951 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.199965 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.200347 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.200436 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.200443 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.200619 (+ 176us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.200658 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:44:44.200771 20060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.197956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:36107 (local address 127.12.145.66:56037)
0619 02:44:44.198017 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:44.198030 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:44:44.198082 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:44:44.198238 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:44:44.198239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:44:44.198243 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:44:44.198320 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.198322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.199030 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.199031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.199847 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:44:44.199849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.200457 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.200458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:44:44.200517 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.200538 (+ 21us) client_negotiation.cc:769] Sending connection context
0619 02:44:44.200595 (+ 57us) client_negotiation.cc:240] Negotiation successful
0619 02:44:44.200631 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260619 02:44:44.201022 20146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6b2da67186a43e1a711bc730c85d527" candidate_uuid: "d58e5113dac04d62981bddf7b753a2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" is_pre_election: true
I20260619 02:44:44.201007 19873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6b2da67186a43e1a711bc730c85d527" candidate_uuid: "d58e5113dac04d62981bddf7b753a2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34c166ec3324133846339e755ffc4eb" is_pre_election: true
I20260619 02:44:44.201149 20146 raft_consensus.cc:2454] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58e5113dac04d62981bddf7b753a2a0 in term 0.
I20260619 02:44:44.201149 19873 raft_consensus.cc:2454] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58e5113dac04d62981bddf7b753a2a0 in term 0.
I20260619 02:44:44.201375 19943 leader_election.cc:302] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3cd3061e2d844ad9fd4c31a045d2308, d58e5113dac04d62981bddf7b753a2a0; no voters:
I20260619 02:44:44.201529 20224 raft_consensus.cc:2781] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:44:44.201586 20224 raft_consensus.cc:482] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:44:44.201610 20224 raft_consensus.cc:3037] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:44.202251 20224 raft_consensus.cc:504] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.202394 20224 leader_election.cc:288] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [CANDIDATE]: Term 1 election: Requested vote from peers c34c166ec3324133846339e755ffc4eb (127.12.145.65:36107), a3cd3061e2d844ad9fd4c31a045d2308 (127.12.145.67:41189)
I20260619 02:44:44.202535 19873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6b2da67186a43e1a711bc730c85d527" candidate_uuid: "d58e5113dac04d62981bddf7b753a2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c34c166ec3324133846339e755ffc4eb"
I20260619 02:44:44.202584 20146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6b2da67186a43e1a711bc730c85d527" candidate_uuid: "d58e5113dac04d62981bddf7b753a2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3cd3061e2d844ad9fd4c31a045d2308"
I20260619 02:44:44.202636 19873 raft_consensus.cc:3037] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:44.202648 20146 raft_consensus.cc:3037] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:44:44.203461 19873 raft_consensus.cc:2454] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58e5113dac04d62981bddf7b753a2a0 in term 1.
I20260619 02:44:44.203461 20146 raft_consensus.cc:2454] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58e5113dac04d62981bddf7b753a2a0 in term 1.
I20260619 02:44:44.203622 19943 leader_election.cc:302] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c34c166ec3324133846339e755ffc4eb, d58e5113dac04d62981bddf7b753a2a0; no voters:
I20260619 02:44:44.203733 20224 raft_consensus.cc:2781] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:44:44.203877 20224 raft_consensus.cc:686] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 1 LEADER]: Becoming Leader. State: Replica: d58e5113dac04d62981bddf7b753a2a0, State: Running, Role: LEADER
I20260619 02:44:44.203970 20224 consensus_queue.cc:237] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } }
I20260619 02:44:44.204803 18954 catalog_manager.cc:5495] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58e5113dac04d62981bddf7b753a2a0 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "d58e5113dac04d62981bddf7b753a2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d58e5113dac04d62981bddf7b753a2a0" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 } health_report { overall_health: UNKNOWN } } }
I20260619 02:44:44.218189 20215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.216134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50836 (local address 127.12.145.66:34161)
0619 02:44:44.216173 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.216177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.216189 (+ 12us) server_negotiation.cc:407] Connection header received
0619 02:44:44.216245 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.216245 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.216259 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.216317 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:44:44.216414 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.216895 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.217580 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.217766 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.217818 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.217928 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:44:44.218027 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:44:44.218077 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.218126 (+ 49us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.218141 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:44:44.219878 19873 raft_consensus.cc:1261] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 1 FOLLOWER]: Refusing update from remote peer d58e5113dac04d62981bddf7b753a2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:44.219878 20146 raft_consensus.cc:1261] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 1 FOLLOWER]: Refusing update from remote peer d58e5113dac04d62981bddf7b753a2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:44:44.220214 20224 consensus_queue.cc:1035] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3cd3061e2d844ad9fd4c31a045d2308" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:44.220366 20227 consensus_queue.cc:1035] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c34c166ec3324133846339e755ffc4eb" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:44:44.223295 20231 mvcc.cc:205] Tried to move back new op lower bound from 7298404696961937408 to 7298404696900198400. Current Snapshot: MvccSnapshot[applied={T|T < 7298404696961937408}]
I20260619 02:44:44.225769 18953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:44.225857 18953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:44:44.227111 18953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3d3e97d189aa47f89e8ed33a531fb900: Sending DeleteTablet for 3 replicas of tablet b6b2da67186a43e1a711bc730c85d527
I20260619 02:44:44.227615 19853 tablet_service.cc:1514] Processing DeleteTablet for tablet b6b2da67186a43e1a711bc730c85d527 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:44 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34038
I20260619 02:44:44.227697 20126 tablet_service.cc:1514] Processing DeleteTablet for tablet b6b2da67186a43e1a711bc730c85d527 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:44 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:48022
I20260619 02:44:44.227939 20240 tablet_replica.cc:330] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: stopping tablet replica
I20260619 02:44:44.227958 19990 tablet_service.cc:1514] Processing DeleteTablet for tablet b6b2da67186a43e1a711bc730c85d527 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:44:44 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:50826
I20260619 02:44:44.228093 20240 raft_consensus.cc:2229] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:44.228259 20240 raft_consensus.cc:2258] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:44.228360 20242 tablet_replica.cc:330] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: stopping tablet replica
I20260619 02:44:44.228477 20242 raft_consensus.cc:2229] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:44:44.228569 20241 tablet_replica.cc:330] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: stopping tablet replica
I20260619 02:44:44.228688 20241 raft_consensus.cc:2229] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:44:44.228621 20242 raft_consensus.cc:2258] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:44.228785 20241 raft_consensus.cc:2258] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:44:44.229249 20242 ts_tablet_manager.cc:1905] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:44.229991 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 18922
I20260619 02:44:44.231163 20242 ts_tablet_manager.cc:1918] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:44.231307 20242 log.cc:1196] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/b6b2da67186a43e1a711bc730c85d527
I20260619 02:44:44.231631 20242 ts_tablet_manager.cc:1939] T b6b2da67186a43e1a711bc730c85d527 P d58e5113dac04d62981bddf7b753a2a0: Deleting consensus metadata
I20260619 02:44:44.234819 20240 ts_tablet_manager.cc:1905] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:44.236382 20240 ts_tablet_manager.cc:1918] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:44.236441 20240 log.cc:1196] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/b6b2da67186a43e1a711bc730c85d527
I20260619 02:44:44.236696 20240 ts_tablet_manager.cc:1939] T b6b2da67186a43e1a711bc730c85d527 P a3cd3061e2d844ad9fd4c31a045d2308: Deleting consensus metadata
W20260619 02:44:44.237157 20081 connection.cc:441] server connection from 127.0.0.1:48022 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48022 (request call id 1) could send its response
W20260619 02:44:44.237164 19944 connection.cc:535] server connection from 127.0.0.1:50826 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 02:44:44.237634 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.228979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35814 (local address 127.12.145.124:38175)
0619 02:44:44.229021 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.229023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.229130 (+ 107us) server_negotiation.cc:407] Connection header received
0619 02:44:44.229227 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.229228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.229239 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.229269 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.230038 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.230835 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.232134 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.232445 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.232519 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.234200 (+ 1681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.234202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.234202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.234209 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.236171 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.236711 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.236712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.236713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.236771 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.236973 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.236975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.236975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.237108 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.237188 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.237418 (+ 230us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.237523 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:44:44.237638 20241 ts_tablet_manager.cc:1905] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:44:44.239401 20241 ts_tablet_manager.cc:1918] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:44:44.239521 20241 log.cc:1196] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/b6b2da67186a43e1a711bc730c85d527
I20260619 02:44:44.239820 20241 ts_tablet_manager.cc:1939] T b6b2da67186a43e1a711bc730c85d527 P c34c166ec3324133846339e755ffc4eb: Deleting consensus metadata
W20260619 02:44:44.240223 19806 connection.cc:441] server connection from 127.0.0.1:34038 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34038 (request call id 1) could send its response
I20260619 02:44:44.246940 20205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.239259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37096 (local address 127.12.145.125:44561)
0619 02:44:44.239305 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.239307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.239495 (+ 188us) server_negotiation.cc:407] Connection header received
0619 02:44:44.239597 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.239599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.239612 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.239643 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.240360 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.241106 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.242071 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.242383 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.242459 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.244053 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.244054 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.244054 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.244061 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.245680 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.246095 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.246096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.246097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.246166 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.246353 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.246354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.246354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.246493 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.246635 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.246749 (+ 114us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.246823 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:44:44.247130 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:44.239386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35830 (local address 127.12.145.124:38175)
0619 02:44:44.239417 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0619 02:44:44.239419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:44:44.239527 (+ 108us) server_negotiation.cc:407] Connection header received
0619 02:44:44.239615 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:44:44.239616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:44:44.239626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:44:44.239653 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:44:44.240792 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.241532 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.242346 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:44:44.242671 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:44:44.242739 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:44:44.244071 (+ 1332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:44:44.244072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:44:44.244073 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:44:44.244079 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:44:44.245750 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.246202 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.246203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.246204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.246255 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:44:44.246470 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:44:44.246471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:44:44.246471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:44:44.246676 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:44:44.246748 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:44:44.246956 (+ 208us) server_negotiation.cc:299] Negotiation successful
0619 02:44:44.247040 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:44:45.223774 20251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:45.223532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:48637)
0619 02:44:45.223654 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:45.223730 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
W20260619 02:44:45.224032 20193 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:44767 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:45.224870 20252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:45.224630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:52675)
0619 02:44:45.224737 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:45.224805 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":53,"threads_started":1}
W20260619 02:44:45.225303 19920 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:44767 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:45.225328 20253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:45.225065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:43769)
0619 02:44:45.225218 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:45.225286 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":51,"threads_started":1}
W20260619 02:44:45.225512 20057 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:44767 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:45.727910 20254 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d3e97d189aa47f89e8ed33a531fb900)
I20260619 02:44:45.728067 20254 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:45.728320 20254 leader_election.cc:288] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767)
I20260619 02:44:45.728608 20255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:45.728423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38532)
0619 02:44:45.728525 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:45.728571 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":66,"threads_started":1}
W20260619 02:44:45.728736 19538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:45.729087 20255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:45.728995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38544)
0619 02:44:45.729043 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:45.729068 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260619 02:44:45.729180 19538 leader_election.cc:334] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767): Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:45.729238 19538 leader_election.cc:302] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c66bed1646e14da3b41d249045ef6aa3; no voters: 3d3e97d189aa47f89e8ed33a531fb900
I20260619 02:44:45.729352 20254 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:44:46.224634 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:46.224395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:37663)
0619 02:44:46.224546 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:46.224589 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260619 02:44:46.226071 20259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:46.225796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:47397)
0619 02:44:46.225993 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:46.226029 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":61,"threads_started":1}
I20260619 02:44:46.226145 20258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:46.225726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:47475)
0619 02:44:46.226037 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:46.226071 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":51,"threads_started":1}
I20260619 02:44:47.225397 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:47.225171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:43223)
0619 02:44:47.225306 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:47.225351 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":61,"threads_started":1}
I20260619 02:44:47.226763 20261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:47.226489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:55605)
0619 02:44:47.226678 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:47.226717 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":84,"threads_started":1}
I20260619 02:44:47.226773 20262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:47.226596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:54541)
0619 02:44:47.226692 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:47.226731 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":40,"threads_started":1}
I20260619 02:44:47.925307 20263 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d3e97d189aa47f89e8ed33a531fb900)
I20260619 02:44:47.925405 20263 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:47.925563 20263 leader_election.cc:288] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767)
I20260619 02:44:47.925959 20264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:47.925766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38888)
0619 02:44:47.925868 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:47.925909 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":59,"threads_started":1}
I20260619 02:44:47.926345 20264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:47.926258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38904)
0619 02:44:47.926302 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:47.926328 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260619 02:44:47.926431 19538 leader_election.cc:334] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767): Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:47.926509 19538 leader_election.cc:302] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c66bed1646e14da3b41d249045ef6aa3; no voters: 3d3e97d189aa47f89e8ed33a531fb900
I20260619 02:44:47.926625 20263 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:44:48.226166 20266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:48.225931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:54313)
0619 02:44:48.226076 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:48.226121 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260619 02:44:48.227360 20267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:48.227144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:44407)
0619 02:44:48.227268 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:48.227317 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":46,"threads_started":1}
I20260619 02:44:48.227532 20268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:48.227298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:54277)
0619 02:44:48.227416 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:48.227491 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260619 02:44:49.226984 20269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:49.226755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:45193)
0619 02:44:49.226877 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:49.226918 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260619 02:44:49.227866 20270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:49.227679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:58871)
0619 02:44:49.227787 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:49.227822 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":60,"threads_started":1}
I20260619 02:44:49.228102 20271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:49.227929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:49637)
0619 02:44:49.228024 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:49.228055 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81,"thread_start_us":45,"threads_started":1}
I20260619 02:44:50.227716 20272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:50.227501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:33715)
0619 02:44:50.227625 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:50.227671 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260619 02:44:50.228633 20273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:50.228413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:57513)
0619 02:44:50.228541 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:50.228581 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":52,"threads_started":1}
I20260619 02:44:50.228863 20274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:50.228564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:39873)
0619 02:44:50.228759 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:50.228795 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":42,"threads_started":1}
I20260619 02:44:51.158727 20275 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d3e97d189aa47f89e8ed33a531fb900)
I20260619 02:44:51.158802 20275 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:51.158910 20275 leader_election.cc:288] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767)
I20260619 02:44:51.159236 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:51.159067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:39250)
0619 02:44:51.159173 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:51.159207 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":60,"threads_started":1}
W20260619 02:44:51.159322 19538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260619 02:44:51.159674 20276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:51.159589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:39262)
0619 02:44:51.159633 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:51.159658 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260619 02:44:51.159772 19538 leader_election.cc:334] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767): Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:51.159833 19538 leader_election.cc:302] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c66bed1646e14da3b41d249045ef6aa3; no voters: 3d3e97d189aa47f89e8ed33a531fb900
I20260619 02:44:51.159932 20275 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:44:51.228790 20278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:51.228325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:48691)
0619 02:44:51.228685 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:51.228734 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":55,"threads_started":1}
I20260619 02:44:51.229285 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:51.229052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:49907)
0619 02:44:51.229208 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:51.229242 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":46,"threads_started":1}
I20260619 02:44:51.229468 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:51.229223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:54853)
0619 02:44:51.229393 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:51.229427 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":46,"threads_started":1}
I20260619 02:44:52.229859 20281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:52.229492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:57693)
0619 02:44:52.229735 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:52.229778 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
I20260619 02:44:52.230180 20282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:52.229825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:39743)
0619 02:44:52.230100 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:52.230137 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":68,"threads_started":1}
I20260619 02:44:52.230283 20283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:52.230003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:42425)
0619 02:44:52.230200 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:52.230238 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":52,"threads_started":1}
I20260619 02:44:53.230772 20284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:53.230433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:45021)
0619 02:44:53.230674 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:53.230716 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":75,"threads_started":1}
I20260619 02:44:53.230950 20285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:53.230744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:40291)
0619 02:44:53.230868 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:53.230903 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260619 02:44:53.231189 20286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:53.230935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:35791)
0619 02:44:53.231115 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:53.231147 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":47,"threads_started":1}
I20260619 02:44:54.231573 20287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:54.231256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:34181)
0619 02:44:54.231421 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:54.231512 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":64,"threads_started":1}
I20260619 02:44:54.231917 20288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:54.231398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:54567)
0619 02:44:54.231801 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:54.231854 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":65,"threads_started":1}
I20260619 02:44:54.231935 20289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:54.231604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:42751)
0619 02:44:54.231859 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:54.231895 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":49,"threads_started":1}
I20260619 02:44:55.232462 20290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:55.232048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:50379)
0619 02:44:55.232182 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:55.232280 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":62,"threads_started":1}
I20260619 02:44:55.232614 20291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:55.232342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:55109)
0619 02:44:55.232472 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:55.232579 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260619 02:44:55.232753 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:55.232403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:42671)
0619 02:44:55.232569 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:55.232604 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":56,"threads_started":1}
I20260619 02:44:56.191061 20293 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d3e97d189aa47f89e8ed33a531fb900)
I20260619 02:44:56.191143 20293 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:44:56.191308 20293 leader_election.cc:288] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767)
I20260619 02:44:56.191608 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:56.191429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:41622)
0619 02:44:56.191527 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:56.191562 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":60,"threads_started":1}
W20260619 02:44:56.191697 19538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:56.192045 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:56.191946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:41636)
0619 02:44:56.191996 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:56.192023 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:44:56.192121 19538 leader_election.cc:334] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767): Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:44:56.192157 19538 leader_election.cc:302] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c66bed1646e14da3b41d249045ef6aa3; no voters: 3d3e97d189aa47f89e8ed33a531fb900
I20260619 02:44:56.192220 20293 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:44:56.233184 20296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:56.232970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:51939)
0619 02:44:56.233085 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:56.233124 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":75,"threads_started":1}
I20260619 02:44:56.233372 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:56.232997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:45187)
0619 02:44:56.233244 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:56.233278 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":69,"threads_started":1}
I20260619 02:44:56.233480 20298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:56.233162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:40141)
0619 02:44:56.233402 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:56.233438 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":48,"threads_started":1}
I20260619 02:44:57.234225 20299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:57.233960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:34363)
0619 02:44:57.234148 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:57.234177 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":64,"threads_started":1}
I20260619 02:44:57.234225 20300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:57.233981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:51873)
0619 02:44:57.234133 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:57.234175 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":52,"threads_started":1}
I20260619 02:44:57.234319 20301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:57.234098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:45163)
0619 02:44:57.234213 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:57.234249 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":41,"threads_started":1}
I20260619 02:44:58.235105 20302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:58.234828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:49389)
0619 02:44:58.234993 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:58.235030 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":60,"threads_started":1}
I20260619 02:44:58.235113 20304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:58.234907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:39285)
0619 02:44:58.235021 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:58.235051 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
I20260619 02:44:58.235113 20303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:58.234828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:45421)
0619 02:44:58.235016 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:58.235051 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":67,"threads_started":1}
I20260619 02:44:59.235922 20307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:59.235636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:54083)
0619 02:44:59.235842 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:59.235872 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260619 02:44:59.236003 20306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:59.235636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:47589)
0619 02:44:59.235769 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:59.235812 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
I20260619 02:44:59.235981 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:44:59.235642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:49259)
0619 02:44:59.235896 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0619 02:44:59.235933 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":73,"threads_started":1}
I20260619 02:45:00.236584 20308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:00.236333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:43855)
0619 02:45:00.236486 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:00.236525 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":66,"threads_started":1}
I20260619 02:45:00.236768 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:00.236426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:47133)
0619 02:45:00.236688 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:00.236724 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":65,"threads_started":1}
I20260619 02:45:00.236831 20310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:00.236455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:40981)
0619 02:45:00.236598 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:00.236787 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":41,"threads_started":1}
I20260619 02:45:01.237288 20311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:01.237074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:49283)
0619 02:45:01.237190 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:01.237234 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":67,"threads_started":1}
I20260619 02:45:01.237481 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:01.237119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:38881)
0619 02:45:01.237398 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:01.237432 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":40,"threads_started":1}
I20260619 02:45:01.237648 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:01.237417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:54213)
0619 02:45:01.237575 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:01.237606 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":41,"threads_started":1}
I20260619 02:45:02.238027 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:02.237749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:59631)
0619 02:45:02.237930 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:02.237972 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":64,"threads_started":1}
I20260619 02:45:02.238039 20315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:02.237860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:55387)
0619 02:45:02.237957 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:02.237992 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":55,"threads_started":1}
I20260619 02:45:02.238261 20316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:02.238025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:45627)
0619 02:45:02.238193 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:02.238224 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":40,"threads_started":1}
I20260619 02:45:02.544482 20317 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d3e97d189aa47f89e8ed33a531fb900)
I20260619 02:45:02.544574 20317 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:45:02.544713 20317 leader_election.cc:288] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767)
I20260619 02:45:02.545028 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:02.544849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:41958)
0619 02:45:02.544947 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:02.544991 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":46,"threads_started":1}
W20260619 02:45:02.545130 19538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:45:02.545513 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:02.545426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:41970)
0619 02:45:02.545471 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:02.545496 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:45:02.545586 19538 leader_election.cc:334] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767): Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:45:02.545639 19538 leader_election.cc:302] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c66bed1646e14da3b41d249045ef6aa3; no voters: 3d3e97d189aa47f89e8ed33a531fb900
I20260619 02:45:02.545720 20317 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:45:03.238713 20320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:03.238418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:43321)
0619 02:45:03.238609 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:03.238653 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":70,"threads_started":1}
I20260619 02:45:03.238793 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:03.238623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:52879)
0619 02:45:03.238730 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:03.238757 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":48,"threads_started":1}
I20260619 02:45:03.238932 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:03.238656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:58581)
0619 02:45:03.238832 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:03.238886 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":43,"threads_started":1}
I20260619 02:45:04.239456 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:04.239214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:60667)
0619 02:45:04.239358 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:04.239402 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260619 02:45:04.239547 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:04.239258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:54891)
0619 02:45:04.239457 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:04.239495 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":72,"threads_started":1}
I20260619 02:45:04.239804 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:04.239426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:39069)
0619 02:45:04.239700 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:04.239736 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":44,"threads_started":1}
I20260619 02:45:05.240279 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:05.240006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:56161)
0619 02:45:05.240180 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:05.240219 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":60,"threads_started":1}
I20260619 02:45:05.240419 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:05.240085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:36007)
0619 02:45:05.240331 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:05.240367 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":57,"threads_started":1}
I20260619 02:45:05.240588 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:05.240367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:43213)
0619 02:45:05.240510 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:05.240544 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":44,"threads_started":1}
I20260619 02:45:06.241034 20329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:06.240721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:53749)
0619 02:45:06.240932 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:06.240977 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":63,"threads_started":1}
I20260619 02:45:06.241184 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:06.240994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:37107)
0619 02:45:06.241100 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:06.241137 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":66,"threads_started":1}
I20260619 02:45:06.241191 20331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:06.240996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:57805)
0619 02:45:06.241127 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:06.241157 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":54,"threads_started":1}
I20260619 02:45:07.241757 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:07.241497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:50301)
0619 02:45:07.241649 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:07.241694 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":68,"threads_started":1}
I20260619 02:45:07.241760 20333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:07.241553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:44619)
0619 02:45:07.241694 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:07.241726 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":45,"threads_started":1}
I20260619 02:45:07.242004 20334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:07.241752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:36913)
0619 02:45:07.241916 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:07.241952 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":57,"threads_started":1}
I20260619 02:45:08.242401 20335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:08.242156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:44229)
0619 02:45:08.242281 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:08.242338 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
I20260619 02:45:08.242487 20336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:08.242202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:53191)
0619 02:45:08.242404 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:08.242440 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":51,"threads_started":1}
I20260619 02:45:08.242734 20337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:08.242455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:54377)
0619 02:45:08.242654 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:08.242690 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":44,"threads_started":1}
I20260619 02:45:08.795469 20338 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d3e97d189aa47f89e8ed33a531fb900)
I20260619 02:45:08.795588 20338 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:45:08.795755 20338 leader_election.cc:288] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767)
I20260619 02:45:08.796111 20339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:08.795931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38326)
0619 02:45:08.796020 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:08.796077 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":51,"threads_started":1}
W20260619 02:45:08.796187 19538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:45:08.796541 20339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:08.796453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38328)
0619 02:45:08.796499 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:08.796524 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 02:45:08.796619 19538 leader_election.cc:334] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767): Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:45:08.796670 19538 leader_election.cc:302] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c66bed1646e14da3b41d249045ef6aa3; no voters: 3d3e97d189aa47f89e8ed33a531fb900
I20260619 02:45:08.796752 20338 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:45:09.243307 20342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:09.242999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:37647)
0619 02:45:09.243186 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:09.243231 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":60,"threads_started":1}
I20260619 02:45:09.243296 20341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:09.242815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:53711)
0619 02:45:09.243201 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:09.243241 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":61,"threads_started":1}
I20260619 02:45:09.243551 20343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:09.243357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:57201)
0619 02:45:09.243482 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:09.243513 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260619 02:45:10.244082 20345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:10.243682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:37579)
0619 02:45:10.243988 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:10.244028 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":61,"threads_started":1}
I20260619 02:45:10.244274 20344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:10.243685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:47443)
0619 02:45:10.244198 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:10.244234 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":62,"threads_started":1}
I20260619 02:45:10.244408 20346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:10.243914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:42157)
0619 02:45:10.244270 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:10.244345 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":50,"threads_started":1}
I20260619 02:45:11.244679 20347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:11.244465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:40441)
0619 02:45:11.244580 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:11.244623 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
I20260619 02:45:11.244889 20348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:11.244531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:41811)
0619 02:45:11.244795 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:11.244837 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":37,"threads_started":1}
I20260619 02:45:11.245198 20349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:11.244913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:60053)
0619 02:45:11.245103 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:11.245135 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":68,"threads_started":1}
I20260619 02:45:12.245465 20350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:12.245182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:52265)
0619 02:45:12.245300 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:12.245343 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
I20260619 02:45:12.245575 20351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:12.245377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:51715)
0619 02:45:12.245496 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:12.245529 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260619 02:45:12.245996 20352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:12.245792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:47037)
0619 02:45:12.245925 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:12.245956 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":49,"threads_started":1}
I20260619 02:45:13.217500 20353 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3d3e97d189aa47f89e8ed33a531fb900)
I20260619 02:45:13.217586 20353 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3d3e97d189aa47f89e8ed33a531fb900" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44767 } } peers { permanent_uuid: "c66bed1646e14da3b41d249045ef6aa3" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 44561 } attrs { promote: false } } peers { permanent_uuid: "18cf97da73a14717af9d81e57f2f4724" member_type: NON_VOTER last_known_addr { host: "127.12.145.124" port: 38175 } attrs { promote: true } }
I20260619 02:45:13.217763 20353 leader_election.cc:288] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767)
I20260619 02:45:13.218096 20354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:13.217914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38496)
0619 02:45:13.218028 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:13.218058 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":67,"threads_started":1}
I20260619 02:45:13.218478 20354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:13.218381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.0.0.1:38504)
0619 02:45:13.218430 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:13.218460 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:45:13.218562 19538 leader_election.cc:334] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3d3e97d189aa47f89e8ed33a531fb900 (127.12.145.126:44767): Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
I20260619 02:45:13.218607 19538 leader_election.cc:302] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: c66bed1646e14da3b41d249045ef6aa3; no voters: 3d3e97d189aa47f89e8ed33a531fb900
I20260619 02:45:13.218675 20353 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c66bed1646e14da3b41d249045ef6aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:45:13.246191 20356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:13.245899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:42897)
0619 02:45:13.246097 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:13.246136 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":89,"threads_started":1}
I20260619 02:45:13.246603 20357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:13.246090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:51775)
0619 02:45:13.246495 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:13.246530 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":49,"threads_started":1}
I20260619 02:45:13.246860 20358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:13.246522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:51445)
0619 02:45:13.246782 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:13.246818 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":82,"threads_started":1}
I20260619 02:45:14.247251 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:14.247011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.67:44987)
0619 02:45:14.247147 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:14.247186 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260619 02:45:14.247368 20359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:14.247008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.65:55965)
0619 02:45:14.247289 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:14.247326 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":64,"threads_started":1}
I20260619 02:45:14.247584 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:14.247307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44767 (local address 127.12.145.66:51161)
0619 02:45:14.247457 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:14.247493 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.12.145.126:44767,127.12.145.125:44561,127.12.145.124:38175, num_attempts: 1)
I20260619 02:45:14.423921 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 19702
I20260619 02:45:14.428985 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 19927
I20260619 02:45:14.434058 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 20063
I20260619 02:45:14.439625 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 19419
I20260619 02:45:14.443835 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 19608
2026-06-19T02:45:14Z chronyd exiting
I20260619 02:45:14.459440 12869 test_util.cc:175] -----------------------------------------------
I20260619 02:45:14.459512 12869 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781837054956172-12869-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (34614 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:45:14 dist-test-slave-fbl4 krb5kdc[20364](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:45:14 dist-test-slave-fbl4 krb5kdc[20364](info): set up 2 sockets
Jun 19 02:45:14 dist-test-slave-fbl4 krb5kdc[20364](info): commencing operation
krb5kdc: starting...
W20260619 02:45:15.487097 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:45:15 dist-test-slave-fbl4 krb5kdc[20364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:45:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:45:15Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab.
Entry for principal oryx/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab.
I20260619 02:45:15.602461 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:37973
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab
--principal=oryx/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:37973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:15.681015 20377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:15.681212 20377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:15.681234 20377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:15.682256 20377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:45:15.682289 20377 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 02:45:15.682322 20377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:15.682335 20377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:15.682348 20377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:45:15.682359 20377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:45:15.683784 20377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:37973
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.126.keytab
--principal=oryx/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:37973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:15.683992 20377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:15.684156 20377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:15.688907 20383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:15.688959 20382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:15.688907 20385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:15.688947 20377 server_base.cc:1034] running on GCE node
I20260619 02:45:15.689406 20377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:15.689689 20377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:15.690851 20377 hybrid_clock.cc:648] HybridClock initialized: now 1781837115690844 us; error 36 us; skew 500 ppm
Jun 19 02:45:15 dist-test-slave-fbl4 krb5kdc[20364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837115, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:15.693173 20377 init.cc:377] Logged in from keytab as oryx/127.12.145.126@KRBTEST.COM (short username oryx)
I20260619 02:45:15.693612 20377 webserver.cc:460] Webserver started at http://127.12.145.126:45675/ using document root <none> and password file <none>
I20260619 02:45:15.693826 20377 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:15.693892 20377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:15.694041 20377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:15.695194 20377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "91a30bb60a80407b96e86e88603f92ca"
format_stamp: "Formatted at 2026-06-19 02:45:15 on dist-test-slave-fbl4"
server_key: "c6e87c7950e36c7fd59320f994b010f5"
server_key_iv: "e2bd02187bf56d7d9554bec481d5c827"
server_key_version: "encryptionkey@0"
I20260619 02:45:15.695580 20377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "91a30bb60a80407b96e86e88603f92ca"
format_stamp: "Formatted at 2026-06-19 02:45:15 on dist-test-slave-fbl4"
server_key: "c6e87c7950e36c7fd59320f994b010f5"
server_key_iv: "e2bd02187bf56d7d9554bec481d5c827"
server_key_version: "encryptionkey@0"
I20260619 02:45:15.696836 20377 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:45:15.697482 20392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:15.697649 20377 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:15.697752 20377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "91a30bb60a80407b96e86e88603f92ca"
format_stamp: "Formatted at 2026-06-19 02:45:15 on dist-test-slave-fbl4"
server_key: "c6e87c7950e36c7fd59320f994b010f5"
server_key_iv: "e2bd02187bf56d7d9554bec481d5c827"
server_key_version: "encryptionkey@0"
I20260619 02:45:15.697826 20377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:15.716471 20377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:15.718160 20377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:15.718317 20377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:15.722980 20377 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:37973
I20260619 02:45:15.723024 20454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:37973 every 8 connection(s)
I20260619 02:45:15.723322 20377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:45:15.723886 20455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:15.726015 20455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Bootstrap starting.
I20260619 02:45:15.726703 20455 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:15.726783 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 20377
I20260619 02:45:15.726905 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:45:15.727041 20455 log.cc:824] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:15.727088 12869 external_mini_cluster.cc:1428] Setting key ecc256537ac94655ffb90ad3be9a3adf
I20260619 02:45:15.727855 20455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: No bootstrap required, opened a new log
I20260619 02:45:15.730300 20455 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a30bb60a80407b96e86e88603f92ca" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 37973 } }
I20260619 02:45:15.730450 20455 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:15.730479 20455 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a30bb60a80407b96e86e88603f92ca, State: Initialized, Role: FOLLOWER
I20260619 02:45:15.730620 20455 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a30bb60a80407b96e86e88603f92ca" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 37973 } }
I20260619 02:45:15.730702 20455 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:45:15.730772 20455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:45:15.730819 20455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:15.731289 20455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a30bb60a80407b96e86e88603f92ca" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 37973 } }
I20260619 02:45:15.731410 20455 leader_election.cc:302] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91a30bb60a80407b96e86e88603f92ca; no voters:
I20260619 02:45:15.731564 20455 leader_election.cc:288] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:45:15.731640 20460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:15.731794 20455 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:45:15.731812 20460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [term 1 LEADER]: Becoming Leader. State: Replica: 91a30bb60a80407b96e86e88603f92ca, State: Running, Role: LEADER
I20260619 02:45:15.731928 20460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a30bb60a80407b96e86e88603f92ca" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 37973 } }
I20260619 02:45:15.732278 20460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91a30bb60a80407b96e86e88603f92ca. Latest consensus state: current_term: 1 leader_uuid: "91a30bb60a80407b96e86e88603f92ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a30bb60a80407b96e86e88603f92ca" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 37973 } } }
I20260619 02:45:15.732372 20460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:15.732288 20461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91a30bb60a80407b96e86e88603f92ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a30bb60a80407b96e86e88603f92ca" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 37973 } } }
I20260619 02:45:15.732511 20461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca [sys.catalog]: This master's current role is: LEADER
W20260619 02:45:15.733624 20476 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:45:15.733690 20476 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:45:15.733757 20469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:45:15.733913 20469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 19 02:45:15 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:45:15.735360 20469 catalog_manager.cc:1347] Generated new cluster ID: d639bb9e9ef74a8d904dd68951694d69
I20260619 02:45:15.735694 20469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:45:15.738786 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:15.727589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.12.145.126:37973)
0619 02:45:15.727777 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:15.727786 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:15.727817 (+ 31us) server_negotiation.cc:407] Connection header received
0619 02:45:15.728319 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:15.728328 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:15.728389 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:15.728535 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:15.729121 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.730528 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.731353 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.732026 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.732686 (+ 660us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:15.735141 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:15.735145 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:15.735145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:15.735157 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:15.737074 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:15.737463 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:15.737465 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:15.737466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:15.737558 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:15.737786 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:15.737788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:15.737788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:15.738115 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:15.738320 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:15.738411 (+ 91us) server_negotiation.cc:299] Negotiation successful
0619 02:45:15.738577 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260619 02:45:15.765568 20469 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:45:15.766139 20469 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:45:15.776742 20469 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Generated new TSK 0
I20260619 02:45:15.776937 20469 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab.
Entry for principal oryx/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab.
I20260619 02:45:15.807292 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:37973
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab
--principal=oryx/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:15.911640 20481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:15.911825 20481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:15.911847 20481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:15.912998 20481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:15.913035 20481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:15.913055 20481 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:45:15.913113 20481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:45:15.914592 20481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab
--principal=oryx/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:37973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:15.914815 20481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:15.915047 20481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:15.919793 20487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:15.919795 20489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:15.919814 20486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:15.919958 20481 server_base.cc:1034] running on GCE node
I20260619 02:45:15.920250 20481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:15.920444 20481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:15.921609 20481 hybrid_clock.cc:648] HybridClock initialized: now 1781837115921602 us; error 36 us; skew 500 ppm
Jun 19 02:45:15 dist-test-slave-fbl4 krb5kdc[20364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837115, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:15.924077 20481 init.cc:377] Logged in from keytab as oryx/127.12.145.65@KRBTEST.COM (short username oryx)
I20260619 02:45:15.924525 20481 webserver.cc:460] Webserver started at http://127.12.145.65:45819/ using document root <none> and password file <none>
I20260619 02:45:15.924737 20481 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:15.924803 20481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:15.924957 20481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:15.925940 20481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
format_stamp: "Formatted at 2026-06-19 02:45:15 on dist-test-slave-fbl4"
server_key: "380909d8b5399908304c77b13cfca0ec"
server_key_iv: "3dd4d5dbde865936fe735360a05176cd"
server_key_version: "encryptionkey@0"
I20260619 02:45:15.926294 20481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
format_stamp: "Formatted at 2026-06-19 02:45:15 on dist-test-slave-fbl4"
server_key: "380909d8b5399908304c77b13cfca0ec"
server_key_iv: "3dd4d5dbde865936fe735360a05176cd"
server_key_version: "encryptionkey@0"
I20260619 02:45:15.927672 20481 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:45:15.928371 20496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:15.928543 20481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:15.928635 20481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
format_stamp: "Formatted at 2026-06-19 02:45:15 on dist-test-slave-fbl4"
server_key: "380909d8b5399908304c77b13cfca0ec"
server_key_iv: "3dd4d5dbde865936fe735360a05176cd"
server_key_version: "encryptionkey@0"
I20260619 02:45:15.928717 20481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:15.954221 20481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:15.956564 20481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:15.956727 20481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:15.957285 20481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:15.957343 20481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:15.957384 20481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:15.957405 20481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 02:45:15 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837115, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:45:15.964779 20481 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:37651
I20260619 02:45:15.964869 20611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:37651 every 8 connection(s)
I20260619 02:45:15.965183 20481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:45:15.967201 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:15.957822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:57311 (local address 127.12.145.126:37973)
0619 02:45:15.957893 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:15.957895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:15.958114 (+ 219us) server_negotiation.cc:407] Connection header received
0619 02:45:15.958895 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:15.958910 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:15.958923 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:15.958989 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:15.959700 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.960272 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.961350 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.961560 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.961655 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:15.964319 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:15.964320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:15.964320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:15.964327 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:15.966023 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:15.966402 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:15.966403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:15.966403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:15.966450 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:15.966722 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:15.966722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:15.966722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:15.966832 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:15.966885 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:15.967082 (+ 197us) server_negotiation.cc:299] Negotiation successful
0619 02:45:15.967141 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:45:15.967424 20505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:15.957783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:37973 (local address 127.12.145.65:57311)
0619 02:45:15.957961 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:15.958022 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:15.958792 (+ 770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:15.959097 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:15.959102 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:15.959375 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:15.959576 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:15.959581 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.960359 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.960360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:15.961259 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:15.961262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.961675 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.961676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:15.961836 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:15.962434 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:15.962442 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:15.964244 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:15.966092 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:15.966095 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:15.966097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:15.966326 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:15.966520 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:15.966521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:15.966521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:15.966666 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:15.966888 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:15.966892 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:15.966994 (+ 102us) client_negotiation.cc:769] Sending connection context
0619 02:45:15.967066 (+ 72us) client_negotiation.cc:240] Negotiation successful
0619 02:45:15.967174 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260619 02:45:15.967888 20612 heartbeater.cc:347] Connected to a master server at 127.12.145.126:37973
I20260619 02:45:15.967983 20612 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:15.968143 20612 heartbeater.cc:511] Master 127.12.145.126:37973 requested a full tablet report, sending...
I20260619 02:45:15.968669 20408 ts_manager.cc:194] Registered new tserver with Master: d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651)
I20260619 02:45:15.969340 20408 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:57311
I20260619 02:45:15.972213 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 20481
I20260619 02:45:15.972362 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:45:15.972584 12869 external_mini_cluster.cc:1428] Setting key 122323f29f13b3221a665d9b16d68ac6
I20260619 02:45:15.974622 20618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:15.968805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:37973 (local address 127.12.145.65:58095)
0619 02:45:15.968942 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:15.968952 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:15.969028 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:15.969145 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:15.969146 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:15.969303 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:15.969352 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:15.969353 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.970074 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.970075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:15.970666 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:15.970668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.971135 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.971136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:15.971220 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:15.971667 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:15.971672 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:15.971958 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:15.973658 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:15.973658 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:15.973659 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:15.973816 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:15.974019 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:15.974020 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:15.974020 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:15.974067 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:15.974321 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:15.974321 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:15.974362 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 02:45:15.974411 (+ 49us) client_negotiation.cc:240] Negotiation successful
0619 02:45:15.974479 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260619 02:45:15.974815 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:15.968851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:58095 (local address 127.12.145.126:37973)
0619 02:45:15.968894 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:15.968896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:15.969015 (+ 119us) server_negotiation.cc:407] Connection header received
0619 02:45:15.969082 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:15.969083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:15.969092 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:15.969141 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:15.969432 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.969985 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.970750 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:15.971078 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:15.971136 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:15.972041 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:15.972043 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:15.972043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:15.972050 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:15.973583 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:15.973897 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:15.973898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:15.973898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:15.973958 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:15.974136 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:15.974136 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:15.974137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:15.974265 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:15.974327 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:15.974451 (+ 124us) server_negotiation.cc:299] Negotiation successful
0619 02:45:15.974545 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for oryx/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab.
Entry for principal oryx/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab.
I20260619 02:45:15.997151 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:37973
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab
--principal=oryx/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:16.076248 20621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:16.076462 20621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:16.076499 20621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:16.077603 20621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:16.077666 20621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:16.077714 20621 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:45:16.077778 20621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:45:16.079278 20621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab
--principal=oryx/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:37973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:16.079535 20621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:16.079741 20621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:16.084559 20627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:16.084540 20626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:16.084547 20629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:16.084623 20621 server_base.cc:1034] running on GCE node
I20260619 02:45:16.084954 20621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:16.085191 20621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:16.086326 20621 hybrid_clock.cc:648] HybridClock initialized: now 1781837116086303 us; error 40 us; skew 500 ppm
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:16.088765 20621 init.cc:377] Logged in from keytab as oryx/127.12.145.66@KRBTEST.COM (short username oryx)
I20260619 02:45:16.089154 20621 webserver.cc:460] Webserver started at http://127.12.145.66:45963/ using document root <none> and password file <none>
I20260619 02:45:16.089357 20621 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:16.089399 20621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:16.089527 20621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:16.090533 20621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "272c8bee4b374f92acfd2bbca34630a8"
format_stamp: "Formatted at 2026-06-19 02:45:16 on dist-test-slave-fbl4"
server_key: "bbe0e91c2afee8ff2f9b84e05c3e2d90"
server_key_iv: "aec5e3eb9240bf463bab8c612ee82e1c"
server_key_version: "encryptionkey@0"
I20260619 02:45:16.090967 20621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "272c8bee4b374f92acfd2bbca34630a8"
format_stamp: "Formatted at 2026-06-19 02:45:16 on dist-test-slave-fbl4"
server_key: "bbe0e91c2afee8ff2f9b84e05c3e2d90"
server_key_iv: "aec5e3eb9240bf463bab8c612ee82e1c"
server_key_version: "encryptionkey@0"
I20260619 02:45:16.092235 20621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:45:16.092895 20636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.093070 20621 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:16.093163 20621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "272c8bee4b374f92acfd2bbca34630a8"
format_stamp: "Formatted at 2026-06-19 02:45:16 on dist-test-slave-fbl4"
server_key: "bbe0e91c2afee8ff2f9b84e05c3e2d90"
server_key_iv: "aec5e3eb9240bf463bab8c612ee82e1c"
server_key_version: "encryptionkey@0"
I20260619 02:45:16.093242 20621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:16.131726 20621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:16.134047 20621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:16.134171 20621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:16.134682 20621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:16.134723 20621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.134748 20621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:16.134793 20621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:45:16.141729 20621 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:46635
I20260619 02:45:16.141785 20751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:46635 every 8 connection(s)
I20260619 02:45:16.142119 20621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:45:16.144061 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.135089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:47021 (local address 127.12.145.126:37973)
0619 02:45:16.135155 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.135157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.135378 (+ 221us) server_negotiation.cc:407] Connection header received
0619 02:45:16.135843 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.135844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.135859 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.135944 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.136772 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.137571 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.139029 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.139241 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.139329 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.141491 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:16.141493 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:16.141493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:16.141500 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:16.143024 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.143379 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.143380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.143380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.143427 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.143620 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.143620 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.143620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.143712 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:16.143768 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.143950 (+ 182us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.144002 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:45:16.144227 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.135079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:37973 (local address 127.12.145.66:47021)
0619 02:45:16.135240 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.135279 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.135745 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.136037 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.136047 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.136399 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:16.136677 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.136684 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.137680 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.137681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.138925 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.138928 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.139349 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.139350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.139487 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.139946 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:16.139960 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:16.141389 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:16.143085 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.143088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.143090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.143312 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.143480 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.143481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.143481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.143568 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.143760 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:16.143763 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:16.143864 (+ 101us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.143941 (+ 77us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.144046 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":97,"threads_started":1}
I20260619 02:45:16.144665 20752 heartbeater.cc:347] Connected to a master server at 127.12.145.126:37973
I20260619 02:45:16.144742 20752 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:16.144923 20752 heartbeater.cc:511] Master 127.12.145.126:37973 requested a full tablet report, sending...
I20260619 02:45:16.145282 20408 ts_manager.cc:194] Registered new tserver with Master: 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:16.145632 20408 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:47021
I20260619 02:45:16.150710 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.145746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:35513 (local address 127.12.145.126:37973)
0619 02:45:16.145797 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.145799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.145859 (+ 60us) server_negotiation.cc:407] Connection header received
0619 02:45:16.145921 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.145922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.145931 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.145980 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.146285 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.146823 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.147532 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.147724 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.147808 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.148535 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:16.148537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:16.148537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:16.148543 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:16.149537 (+ 994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.149904 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.149905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.149906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.149961 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.150149 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.150150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.150150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.150288 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:16.150376 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.150536 (+ 160us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.150627 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260619 02:45:16.150724 20758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.145682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:37973 (local address 127.12.145.66:35513)
0619 02:45:16.145804 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.145814 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.145870 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.145986 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.145986 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.146148 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:16.146196 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.146197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.146910 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.146911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.147434 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.147435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.147810 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.147811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.147878 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.148203 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:16.148207 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:16.148452 (+ 245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:16.149626 (+ 1174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.149627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.149628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.149808 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.150025 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.150026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.150026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.150087 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.150379 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:16.150380 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:16.150426 (+ 46us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.150510 (+ 84us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.150623 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260619 02:45:16.151952 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 20621
I20260619 02:45:16.152065 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:45:16.152230 12869 external_mini_cluster.cc:1428] Setting key 91cac33600d4c2d505b1aeca761407ba
WARNING: no policy specified for oryx/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab.
Entry for principal oryx/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab.
I20260619 02:45:16.175081 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:37973
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab
--principal=oryx/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:16.254530 20761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:16.254792 20761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:16.254817 20761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:16.255913 20761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:16.255949 20761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:16.255970 20761 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 02:45:16.255986 20761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:45:16.257438 20761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab
--principal=oryx/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.145.126:37973
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:16.257647 20761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:16.257813 20761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:16.263547 20769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:16.263568 20767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:16.263547 20766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:16.263710 20761 server_base.cc:1034] running on GCE node
I20260619 02:45:16.263924 20761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:16.264168 20761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:16.265331 20761 hybrid_clock.cc:648] HybridClock initialized: now 1781837116265315 us; error 31 us; skew 500 ppm
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:16.267918 20761 init.cc:377] Logged in from keytab as oryx/127.12.145.67@KRBTEST.COM (short username oryx)
I20260619 02:45:16.268397 20761 webserver.cc:460] Webserver started at http://127.12.145.67:45703/ using document root <none> and password file <none>
I20260619 02:45:16.268617 20761 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:16.268679 20761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:16.268818 20761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:16.269843 20761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "33494be5f6e64e4c9737e0f079960c2a"
format_stamp: "Formatted at 2026-06-19 02:45:16 on dist-test-slave-fbl4"
server_key: "d7d9af7a1f97d0d284073e719d9d2fa9"
server_key_iv: "c8012daa315c3c3abd19b645b4dc97c3"
server_key_version: "encryptionkey@0"
I20260619 02:45:16.270205 20761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "33494be5f6e64e4c9737e0f079960c2a"
format_stamp: "Formatted at 2026-06-19 02:45:16 on dist-test-slave-fbl4"
server_key: "d7d9af7a1f97d0d284073e719d9d2fa9"
server_key_iv: "c8012daa315c3c3abd19b645b4dc97c3"
server_key_version: "encryptionkey@0"
I20260619 02:45:16.271570 20761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:45:16.272269 20776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.272433 20761 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:45:16.272526 20761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "33494be5f6e64e4c9737e0f079960c2a"
format_stamp: "Formatted at 2026-06-19 02:45:16 on dist-test-slave-fbl4"
server_key: "d7d9af7a1f97d0d284073e719d9d2fa9"
server_key_iv: "c8012daa315c3c3abd19b645b4dc97c3"
server_key_version: "encryptionkey@0"
I20260619 02:45:16.272605 20761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:16.301437 20761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:16.303764 20761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:16.303912 20761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:16.304474 20761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:16.304522 20761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.304554 20761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:16.304598 20761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:45:16.311669 20761 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:42597
I20260619 02:45:16.311982 20761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:45:16.311982 20891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:42597 every 8 connection(s)
I20260619 02:45:16.313992 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.304868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:51537 (local address 127.12.145.126:37973)
0619 02:45:16.304928 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.304931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.305168 (+ 237us) server_negotiation.cc:407] Connection header received
0619 02:45:16.305642 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.305643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.305657 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.305743 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.306635 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.307449 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.308449 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.308658 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.308738 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.311430 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:16.311432 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:16.311432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:16.311441 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:16.312921 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.313274 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.313275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.313275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.313323 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.313518 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.313519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.313519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.313613 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:16.313661 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.313875 (+ 214us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.313930 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260619 02:45:16.314215 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.304876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:37973 (local address 127.12.145.67:51537)
0619 02:45:16.305032 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.305070 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.305552 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.305831 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.305836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.306213 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:16.306504 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.306510 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.307550 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.307551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.308331 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.308333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.308753 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.308754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.308924 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.309403 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:16.309417 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:16.311316 (+ 1899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:16.312988 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.312991 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.312993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.313194 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.313376 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.313377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.313377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.313468 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.313667 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:16.313670 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:16.313774 (+ 104us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.313853 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.313964 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260619 02:45:16.314752 20892 heartbeater.cc:347] Connected to a master server at 127.12.145.126:37973
I20260619 02:45:16.314832 20892 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:16.315003 20892 heartbeater.cc:511] Master 127.12.145.126:37973 requested a full tablet report, sending...
I20260619 02:45:16.315371 20408 ts_manager.cc:194] Registered new tserver with Master: 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67:42597)
I20260619 02:45:16.315837 20408 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:51537
I20260619 02:45:16.319810 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 20761
I20260619 02:45:16.319918 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:45:16.320109 12869 external_mini_cluster.cc:1428] Setting key fdf3855035bdfaf8ae2d145bb7b70583
I20260619 02:45:16.320871 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:45:16.321619 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.315891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:44153 (local address 127.12.145.126:37973)
0619 02:45:16.315989 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.315990 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.316000 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:45:16.316055 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.316056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.316065 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.316121 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.316882 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.317340 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.318034 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.318236 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.318330 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.319178 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:16.319179 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:16.319179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:16.319186 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:16.320493 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.320831 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.320832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.320832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.320890 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.321118 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.321118 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.321119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.321227 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:16.321296 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.321463 (+ 167us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.321529 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 02:45:16.321633 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.315762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:37973 (local address 127.12.145.67:44153)
0619 02:45:16.315903 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.315931 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.315994 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.316127 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.316127 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.316746 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:16.316796 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.316798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.317435 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.317436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.317940 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.317942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.318333 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.318334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.318408 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.318801 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:16.318805 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:16.319076 (+ 271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:16.320586 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.320587 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.320588 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.320759 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.320982 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.320982 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.320983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.321044 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.321299 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:16.321300 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:16.321342 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.321435 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.321531 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":62,"threads_started":1}
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 02:45:16.341395 20459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:16.336216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34972 (local address 127.12.145.126:37973)
0619 02:45:16.336276 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.336278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.336287 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:16.336360 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.336361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.336373 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.336440 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.337007 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.337458 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.338191 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.338375 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.338457 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.341317 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34972: BlockingRecv error: recv got EOF from 127.0.0.1:34972 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:45:16.348719 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.342214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34978 (local address 127.12.145.126:37973)
0619 02:45:16.342278 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.342280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.342363 (+ 83us) server_negotiation.cc:407] Connection header received
0619 02:45:16.342433 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.342433 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.342442 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.342484 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.343004 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.343444 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.344091 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.344287 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.344394 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.346453 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:16.346454 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:16.346455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:16.346462 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:16.347642 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.347977 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.347978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.347979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.348032 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.348236 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.348237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.348237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.348344 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:16.348449 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.348549 (+ 100us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.348622 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:45:16.350137 20408 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:45:16.351773 20408 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:45:16.357899 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.354187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42210 (local address 127.12.145.67:42597)
0619 02:45:16.354359 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.354363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.354375 (+ 12us) server_negotiation.cc:407] Connection header received
0619 02:45:16.354443 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.354444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.354458 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.354569 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:16.354783 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.355493 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.356862 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.357458 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.357550 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.357625 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.357773 (+ 148us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.357813 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":74,"threads_started":1}
I20260619 02:45:16.358091 20919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.354200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54506 (local address 127.12.145.66:46635)
0619 02:45:16.354389 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.354393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.354401 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:16.354439 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.354441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.354457 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.354579 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:16.354799 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.355894 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.356911 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.357572 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.357640 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.357706 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.357946 (+ 240us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.357986 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":98,"threads_started":1}
I20260619 02:45:16.357894 20916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.353959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42597 (local address 127.0.0.1:42210)
0619 02:45:16.354323 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.354332 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.354370 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.354632 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.354633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.354635 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:16.354689 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.354691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.355583 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.355584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.356767 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.356770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.357549 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.357549 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.357633 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.357646 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.357755 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.357809 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":3,"thread_start_us":91,"threads_started":1}
I20260619 02:45:16.358274 20915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.353915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:37651 (local address 127.0.0.1:40176)
0619 02:45:16.354111 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.354163 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.354229 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.354673 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.354674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.354676 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:16.354715 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.354716 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.355989 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.355990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.357088 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.357090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.358040 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.358041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.358102 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.358106 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.358167 (+ 61us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.358204 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":30,"thread_start_us":37,"threads_started":1}
I20260619 02:45:16.358168 20914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.353957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:46635 (local address 127.0.0.1:54506)
0619 02:45:16.354248 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.354266 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.354310 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.354595 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.354598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.354600 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:16.354699 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.354701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.355987 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.355988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.356821 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.356823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.357742 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.357743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.357803 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.357807 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.357858 (+ 51us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.357900 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260619 02:45:16.358843 20917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.354012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40176 (local address 127.12.145.65:37651)
0619 02:45:16.354194 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.354199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.354210 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:45:16.354503 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.354505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.354522 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.354612 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:16.354791 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.355886 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.357170 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.357879 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.357940 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.358008 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.358428 (+ 420us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.358472 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":69,"threads_started":1}
I20260619 02:45:16.358963 20826 tablet_service.cc:1467] Processing CreateTablet for tablet 90875ea3184a4d61b2ea647a011fe4bb (DEFAULT_TABLE table=test-table [id=4f72dd3dfdb24ec1a02ca29bd41ef1f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.359164 20686 tablet_service.cc:1467] Processing CreateTablet for tablet 90875ea3184a4d61b2ea647a011fe4bb (DEFAULT_TABLE table=test-table [id=4f72dd3dfdb24ec1a02ca29bd41ef1f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.359319 20826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90875ea3184a4d61b2ea647a011fe4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.359412 20686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90875ea3184a4d61b2ea647a011fe4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.359388 20546 tablet_service.cc:1467] Processing CreateTablet for tablet 90875ea3184a4d61b2ea647a011fe4bb (DEFAULT_TABLE table=test-table [id=4f72dd3dfdb24ec1a02ca29bd41ef1f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.359676 20546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90875ea3184a4d61b2ea647a011fe4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.362402 20920 tablet_bootstrap.cc:492] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Bootstrap starting.
I20260619 02:45:16.363075 20920 tablet_bootstrap.cc:654] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.363058 20921 tablet_bootstrap.cc:492] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Bootstrap starting.
I20260619 02:45:16.363385 20920 log.cc:824] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:16.363483 20922 tablet_bootstrap.cc:492] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Bootstrap starting.
I20260619 02:45:16.363695 20921 tablet_bootstrap.cc:654] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.364027 20921 log.cc:824] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:16.364073 20922 tablet_bootstrap.cc:654] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.364445 20922 log.cc:824] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:16.364495 20920 tablet_bootstrap.cc:492] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: No bootstrap required, opened a new log
I20260619 02:45:16.364578 20920 ts_tablet_manager.cc:1397] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:45:16.364989 20921 tablet_bootstrap.cc:492] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: No bootstrap required, opened a new log
I20260619 02:45:16.365116 20921 ts_tablet_manager.cc:1397] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:45:16.365231 20922 tablet_bootstrap.cc:492] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: No bootstrap required, opened a new log
I20260619 02:45:16.365321 20922 ts_tablet_manager.cc:1397] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:45:16.366287 20920 raft_consensus.cc:348] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.366439 20920 raft_consensus.cc:374] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.366483 20920 raft_consensus.cc:729] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 272c8bee4b374f92acfd2bbca34630a8, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.366622 20920 consensus_queue.cc:260] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.366917 20752 heartbeater.cc:503] Master 127.12.145.126:37973 was elected leader, sending a full tablet report...
I20260619 02:45:16.366901 20920 ts_tablet_manager.cc:1428] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:45:16.367275 20922 raft_consensus.cc:348] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.367465 20922 raft_consensus.cc:374] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.367496 20922 raft_consensus.cc:729] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d103d3563a8c4ff69bd702a6e0aee78c, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.367600 20922 consensus_queue.cc:260] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.367573 20921 raft_consensus.cc:348] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.367841 20922 ts_tablet_manager.cc:1428] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 02:45:16.367873 20612 heartbeater.cc:503] Master 127.12.145.126:37973 was elected leader, sending a full tablet report...
I20260619 02:45:16.367898 20921 raft_consensus.cc:374] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.367949 20921 raft_consensus.cc:729] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.368067 20921 consensus_queue.cc:260] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.368316 20921 ts_tablet_manager.cc:1428] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 02:45:16.368381 20892 heartbeater.cc:503] Master 127.12.145.126:37973 was elected leader, sending a full tablet report...
W20260619 02:45:16.392691 20753 tablet.cc:2369] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:45:16.465987 20613 tablet.cc:2369] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:45:16.512825 20928 raft_consensus.cc:482] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:45:16.513026 20928 raft_consensus.cc:504] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.513412 20928 leader_election.cc:288] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:16.516356 20917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.513689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:43861 (local address 127.12.145.65:37651)
0619 02:45:16.513737 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.513739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.513750 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:45:16.513796 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.513797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.513806 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.513923 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:16.514077 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.514630 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.515614 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.515993 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.516078 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.516087 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.516252 (+ 165us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.516288 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260619 02:45:16.516356 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.513641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:37651 (local address 127.12.145.67:43861)
0619 02:45:16.513682 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.513693 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.513736 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.513929 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.513930 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.513932 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:16.514001 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.514003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.514708 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.514709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.515506 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.515509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.516075 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.516076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.516174 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.516177 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.516245 (+ 68us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.516288 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260619 02:45:16.516623 20919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.513747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:57769 (local address 127.12.145.66:46635)
0619 02:45:16.513786 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.513788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.513959 (+ 171us) server_negotiation.cc:407] Connection header received
0619 02:45:16.514012 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.514013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.514022 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.514093 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:16.514272 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.514800 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.515827 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.516225 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.516315 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.516322 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.516503 (+ 181us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.516544 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:45:16.516713 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90875ea3184a4d61b2ea647a011fe4bb" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" is_pre_election: true
I20260619 02:45:16.516870 20929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.513640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:46635 (local address 127.12.145.67:57769)
0619 02:45:16.513886 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.513894 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.513959 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.514095 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.514096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.514097 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:16.514183 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.514184 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.514906 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.514906 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.515743 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.515745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.516316 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.516317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.516386 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.516390 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.516730 (+ 340us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.516772 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":47,"thread_start_us":117,"threads_started":1}
I20260619 02:45:16.516880 20566 raft_consensus.cc:2454] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:16.517110 20778 leader_election.cc:302] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33494be5f6e64e4c9737e0f079960c2a, d103d3563a8c4ff69bd702a6e0aee78c; no voters:
I20260619 02:45:16.517144 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90875ea3184a4d61b2ea647a011fe4bb" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8" is_pre_election: true
I20260619 02:45:16.517228 20928 raft_consensus.cc:2781] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:45:16.517284 20928 raft_consensus.cc:482] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:45:16.517302 20706 raft_consensus.cc:2454] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:16.517315 20928 raft_consensus.cc:3037] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.518270 20928 raft_consensus.cc:504] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.518416 20928 leader_election.cc:288] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Requested vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:16.518568 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90875ea3184a4d61b2ea647a011fe4bb" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
I20260619 02:45:16.518606 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90875ea3184a4d61b2ea647a011fe4bb" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8"
I20260619 02:45:16.518646 20566 raft_consensus.cc:3037] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.518712 20706 raft_consensus.cc:3037] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.519369 20566 raft_consensus.cc:2454] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:16.519387 20706 raft_consensus.cc:2454] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:16.519520 20778 leader_election.cc:302] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33494be5f6e64e4c9737e0f079960c2a, d103d3563a8c4ff69bd702a6e0aee78c; no voters:
I20260619 02:45:16.519603 20928 raft_consensus.cc:2781] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:16.519747 20928 raft_consensus.cc:686] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 1 LEADER]: Becoming Leader. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Running, Role: LEADER
I20260619 02:45:16.519857 20928 consensus_queue.cc:237] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } }
I20260619 02:45:16.520643 20408 catalog_manager.cc:5495] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67). New cstate: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } health_report { overall_health: UNKNOWN } } }
I20260619 02:45:16.537778 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.535767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42224 (local address 127.12.145.67:42597)
0619 02:45:16.535821 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.535823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.535830 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:45:16.535861 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.535861 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.535877 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.535938 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:16.536051 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.536506 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.537184 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.537355 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.537401 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.537520 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.537613 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.537671 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.537701 (+ 30us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.537717 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260619 02:45:16.539708 20566 raft_consensus.cc:1261] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.539733 20706 raft_consensus.cc:1261] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.540094 20930 consensus_queue.cc:1035] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.540241 20928 consensus_queue.cc:1035] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.542785 20935 mvcc.cc:205] Tried to move back new op lower bound from 7298404829343522816 to 7298404829266030592. Current Snapshot: MvccSnapshot[applied={T|T < 7298404829343522816}]
I20260619 02:45:16.542961 20934 mvcc.cc:205] Tried to move back new op lower bound from 7298404829343522816 to 7298404829266030592. Current Snapshot: MvccSnapshot[applied={T|T < 7298404829343522816}]
I20260619 02:45:16.545436 20409 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:16.545535 20409 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:16.546293 20409 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Sending DeleteTablet for 3 replicas of tablet 90875ea3184a4d61b2ea647a011fe4bb
I20260619 02:45:16.546607 20826 tablet_service.cc:1514] Processing DeleteTablet for tablet 90875ea3184a4d61b2ea647a011fe4bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:42210
I20260619 02:45:16.546793 20686 tablet_service.cc:1514] Processing DeleteTablet for tablet 90875ea3184a4d61b2ea647a011fe4bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:54506
I20260619 02:45:16.546793 20546 tablet_service.cc:1514] Processing DeleteTablet for tablet 90875ea3184a4d61b2ea647a011fe4bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:40176
I20260619 02:45:16.546847 20943 tablet_replica.cc:330] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: stopping tablet replica
I20260619 02:45:16.546936 20943 raft_consensus.cc:2229] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:45:16.547068 20943 raft_consensus.cc:2258] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.547087 20945 tablet_replica.cc:330] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: stopping tablet replica
I20260619 02:45:16.547199 20945 raft_consensus.cc:2229] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:16.547174 20409 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 02:45:16.547312 20945 raft_consensus.cc:2258] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 02:45:16.547317 20409 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:45:16.547570 20944 tablet_replica.cc:330] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: stopping tablet replica
I20260619 02:45:16.547725 20944 raft_consensus.cc:2229] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:16.547804 20943 ts_tablet_manager.cc:1905] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.547891 20944 raft_consensus.cc:2258] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.548357 20944 ts_tablet_manager.cc:1905] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.548836 20826 tablet_service.cc:1467] Processing CreateTablet for tablet 16c37b526f434861bd4702e607978097 (DEFAULT_TABLE table=test-table [id=833f266dc5f34045a86f0c1a035ca8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.548839 20686 tablet_service.cc:1467] Processing CreateTablet for tablet 16c37b526f434861bd4702e607978097 (DEFAULT_TABLE table=test-table [id=833f266dc5f34045a86f0c1a035ca8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.548950 20686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16c37b526f434861bd4702e607978097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.549007 20826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16c37b526f434861bd4702e607978097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.550071 20921 tablet_bootstrap.cc:492] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Bootstrap starting.
I20260619 02:45:16.550278 20920 tablet_bootstrap.cc:492] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: Bootstrap starting.
I20260619 02:45:16.550499 20921 tablet_bootstrap.cc:654] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.550729 20546 tablet_service.cc:1467] Processing CreateTablet for tablet 16c37b526f434861bd4702e607978097 (DEFAULT_TABLE table=test-table [id=833f266dc5f34045a86f0c1a035ca8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.550801 20945 ts_tablet_manager.cc:1905] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.550845 20546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16c37b526f434861bd4702e607978097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.551115 20921 tablet_bootstrap.cc:492] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: No bootstrap required, opened a new log
I20260619 02:45:16.551152 20921 ts_tablet_manager.cc:1397] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260619 02:45:16.551298 20921 raft_consensus.cc:348] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.551378 20921 raft_consensus.cc:374] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.551399 20921 raft_consensus.cc:729] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.551442 20921 consensus_queue.cc:260] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.551529 20921 ts_tablet_manager.cc:1428] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.551959 20943 ts_tablet_manager.cc:1918] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:45:16.552017 20943 log.cc:1196] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/90875ea3184a4d61b2ea647a011fe4bb
I20260619 02:45:16.552182 20922 tablet_bootstrap.cc:492] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: Bootstrap starting.
I20260619 02:45:16.552279 20943 ts_tablet_manager.cc:1939] T 90875ea3184a4d61b2ea647a011fe4bb P 33494be5f6e64e4c9737e0f079960c2a: Deleting consensus metadata
I20260619 02:45:16.552474 20945 ts_tablet_manager.cc:1918] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:45:16.552531 20945 log.cc:1196] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/90875ea3184a4d61b2ea647a011fe4bb
I20260619 02:45:16.552531 20922 tablet_bootstrap.cc:654] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.552744 20945 ts_tablet_manager.cc:1939] T 90875ea3184a4d61b2ea647a011fe4bb P 272c8bee4b374f92acfd2bbca34630a8: Deleting consensus metadata
I20260619 02:45:16.552975 20395 catalog_manager.cc:4841] TS 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67:42597): tablet 90875ea3184a4d61b2ea647a011fe4bb (table test-table [id=4f72dd3dfdb24ec1a02ca29bd41ef1f7]) successfully deleted
I20260619 02:45:16.553452 20396 catalog_manager.cc:4841] TS 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635): tablet 90875ea3184a4d61b2ea647a011fe4bb (table test-table [id=4f72dd3dfdb24ec1a02ca29bd41ef1f7]) successfully deleted
I20260619 02:45:16.553665 20920 tablet_bootstrap.cc:654] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.554095 20922 tablet_bootstrap.cc:492] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: No bootstrap required, opened a new log
I20260619 02:45:16.554160 20922 ts_tablet_manager.cc:1397] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260619 02:45:16.554248 20920 tablet_bootstrap.cc:492] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: No bootstrap required, opened a new log
I20260619 02:45:16.554279 20920 ts_tablet_manager.cc:1397] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260619 02:45:16.554306 20922 raft_consensus.cc:348] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.554371 20922 raft_consensus.cc:374] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.554391 20922 raft_consensus.cc:729] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d103d3563a8c4ff69bd702a6e0aee78c, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.554430 20922 consensus_queue.cc:260] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.554383 20920 raft_consensus.cc:348] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.554481 20920 raft_consensus.cc:374] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.554510 20920 raft_consensus.cc:729] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 272c8bee4b374f92acfd2bbca34630a8, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.554522 20922 ts_tablet_manager.cc:1428] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.554575 20920 consensus_queue.cc:260] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.554669 20920 ts_tablet_manager.cc:1428] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.556479 20944 ts_tablet_manager.cc:1918] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:45:16.556555 20944 log.cc:1196] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/90875ea3184a4d61b2ea647a011fe4bb
I20260619 02:45:16.557107 20944 ts_tablet_manager.cc:1939] T 90875ea3184a4d61b2ea647a011fe4bb P d103d3563a8c4ff69bd702a6e0aee78c: Deleting consensus metadata
I20260619 02:45:16.557494 20394 catalog_manager.cc:4841] TS d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651): tablet 90875ea3184a4d61b2ea647a011fe4bb (table test-table [id=4f72dd3dfdb24ec1a02ca29bd41ef1f7]) successfully deleted
W20260619 02:45:16.562597 20893 tablet.cc:2369] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:45:16.608219 20926 raft_consensus.cc:482] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:45:16.608333 20926 raft_consensus.cc:504] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.608668 20926 leader_election.cc:288] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67:42597)
I20260619 02:45:16.612075 20917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.608997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:53221 (local address 127.12.145.65:37651)
0619 02:45:16.609037 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.609039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.609050 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:45:16.609177 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.609179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.609188 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.609236 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:16.609394 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.610116 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.611183 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.611691 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.611764 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.611772 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.611965 (+ 193us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.612008 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:45:16.612200 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.608898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:46303 (local address 127.12.145.67:42597)
0619 02:45:16.608940 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.608942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.608950 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:16.608980 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.608981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.608991 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.609043 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:16.609241 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.610024 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.611356 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.611865 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.611941 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.611948 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.612107 (+ 159us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.612139 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260619 02:45:16.612201 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.608818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42597 (local address 127.12.145.66:46303)
0619 02:45:16.608869 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.608882 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.608922 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.609096 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.609098 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.609100 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:16.609168 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.609169 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.610140 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.610141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.611266 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.611269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.611950 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.611951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.612035 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.612038 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.612101 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.612138 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260619 02:45:16.612453 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.608827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:37651 (local address 127.12.145.66:53221)
0619 02:45:16.609009 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.609017 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.609054 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.609263 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.609264 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.609266 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:16.609326 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.609327 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.610175 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.610177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.611096 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.611099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.611794 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.611795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.611864 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.611868 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.612341 (+ 473us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.612380 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":74,"threads_started":1}
I20260619 02:45:16.612475 20846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16c37b526f434861bd4702e607978097" candidate_uuid: "272c8bee4b374f92acfd2bbca34630a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33494be5f6e64e4c9737e0f079960c2a" is_pre_election: true
I20260619 02:45:16.612597 20846 raft_consensus.cc:2454] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 272c8bee4b374f92acfd2bbca34630a8 in term 0.
I20260619 02:45:16.612674 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16c37b526f434861bd4702e607978097" candidate_uuid: "272c8bee4b374f92acfd2bbca34630a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" is_pre_election: true
I20260619 02:45:16.612756 20566 raft_consensus.cc:2454] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 272c8bee4b374f92acfd2bbca34630a8 in term 0.
I20260619 02:45:16.612771 20639 leader_election.cc:302] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 272c8bee4b374f92acfd2bbca34630a8, 33494be5f6e64e4c9737e0f079960c2a; no voters:
I20260619 02:45:16.612895 20926 raft_consensus.cc:2781] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:45:16.612946 20926 raft_consensus.cc:482] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:45:16.612967 20926 raft_consensus.cc:3037] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.613827 20926 raft_consensus.cc:504] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.613982 20926 leader_election.cc:288] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [CANDIDATE]: Term 1 election: Requested vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67:42597)
I20260619 02:45:16.614089 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16c37b526f434861bd4702e607978097" candidate_uuid: "272c8bee4b374f92acfd2bbca34630a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
I20260619 02:45:16.614171 20566 raft_consensus.cc:3037] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.614162 20846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16c37b526f434861bd4702e607978097" candidate_uuid: "272c8bee4b374f92acfd2bbca34630a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33494be5f6e64e4c9737e0f079960c2a"
I20260619 02:45:16.614223 20846 raft_consensus.cc:3037] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.614986 20566 raft_consensus.cc:2454] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 272c8bee4b374f92acfd2bbca34630a8 in term 1.
I20260619 02:45:16.614986 20846 raft_consensus.cc:2454] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 272c8bee4b374f92acfd2bbca34630a8 in term 1.
I20260619 02:45:16.615160 20638 leader_election.cc:302] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 272c8bee4b374f92acfd2bbca34630a8, d103d3563a8c4ff69bd702a6e0aee78c; no voters:
I20260619 02:45:16.615242 20926 raft_consensus.cc:2781] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:16.615340 20926 raft_consensus.cc:686] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 LEADER]: Becoming Leader. State: Replica: 272c8bee4b374f92acfd2bbca34630a8, State: Running, Role: LEADER
I20260619 02:45:16.615410 20926 consensus_queue.cc:237] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.615996 20408 catalog_manager.cc:5495] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "272c8bee4b374f92acfd2bbca34630a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } health_report { overall_health: UNKNOWN } } }
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837115, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.126@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:45:16.662657 20957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.655276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:37973 (local address 127.0.0.1:34988)
0619 02:45:16.655425 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.655443 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.655504 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.655659 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.655660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.655944 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:16.655992 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.655994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.656920 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.656921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.657441 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.657442 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.657905 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.657906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.657947 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.658525 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:16.658529 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:16.659957 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:16.661616 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.661623 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.661625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.661816 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.662022 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:16.662022 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:16.662023 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:16.662076 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:16.662325 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:16.662330 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:16.662367 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.662416 (+ 49us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.662500 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260619 02:45:16.662721 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.655348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34988 (local address 127.12.145.126:37973)
0619 02:45:16.655404 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.655406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.655507 (+ 101us) server_negotiation.cc:407] Connection header received
0619 02:45:16.655578 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.655579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.655589 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.655647 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.656062 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.656842 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.657514 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.657827 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.657897 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.660058 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:16.660060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:16.660061 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:16.660067 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:16.661538 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.661899 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.661900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.661901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.661959 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.662134 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.662134 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.662135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.662261 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:16.662327 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.662461 (+ 134us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.662576 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":34}
I20260619 02:45:16.664795 20408 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34988:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 02:45:16.664965 20408 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:45:16.666355 20546 tablet_service.cc:1467] Processing CreateTablet for tablet a26cd2fa9a794c2ca91d2f2350d54f66 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d9eab73fa6e44729a30b530ecbdaeeec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:45:16.666374 20686 tablet_service.cc:1467] Processing CreateTablet for tablet a26cd2fa9a794c2ca91d2f2350d54f66 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d9eab73fa6e44729a30b530ecbdaeeec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:45:16.666452 20826 tablet_service.cc:1467] Processing CreateTablet for tablet a26cd2fa9a794c2ca91d2f2350d54f66 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d9eab73fa6e44729a30b530ecbdaeeec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 02:45:16.666539 20546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a26cd2fa9a794c2ca91d2f2350d54f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.666539 20686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a26cd2fa9a794c2ca91d2f2350d54f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.666594 20826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a26cd2fa9a794c2ca91d2f2350d54f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.667796 20922 tablet_bootstrap.cc:492] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: Bootstrap starting.
I20260619 02:45:16.667975 20921 tablet_bootstrap.cc:492] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: Bootstrap starting.
I20260619 02:45:16.667985 20920 tablet_bootstrap.cc:492] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: Bootstrap starting.
I20260619 02:45:16.668267 20922 tablet_bootstrap.cc:654] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.668286 20921 tablet_bootstrap.cc:654] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.668396 20920 tablet_bootstrap.cc:654] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.668824 20921 tablet_bootstrap.cc:492] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: No bootstrap required, opened a new log
I20260619 02:45:16.668879 20921 ts_tablet_manager.cc:1397] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260619 02:45:16.668964 20922 tablet_bootstrap.cc:492] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: No bootstrap required, opened a new log
I20260619 02:45:16.668977 20920 tablet_bootstrap.cc:492] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: No bootstrap required, opened a new log
I20260619 02:45:16.669003 20922 ts_tablet_manager.cc:1397] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:45:16.669008 20920 ts_tablet_manager.cc:1397] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260619 02:45:16.668978 20921 raft_consensus.cc:348] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.669051 20921 raft_consensus.cc:374] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.669080 20921 raft_consensus.cc:729] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.669128 20921 consensus_queue.cc:260] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.669109 20920 raft_consensus.cc:348] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.669132 20922 raft_consensus.cc:348] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.669196 20922 raft_consensus.cc:374] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.669193 20920 raft_consensus.cc:374] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.669217 20920 raft_consensus.cc:729] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 272c8bee4b374f92acfd2bbca34630a8, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.669217 20922 raft_consensus.cc:729] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d103d3563a8c4ff69bd702a6e0aee78c, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.669219 20921 ts_tablet_manager.cc:1428] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.669262 20922 consensus_queue.cc:260] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.669237 20938 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.669271 20920 consensus_queue.cc:260] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.669330 20938 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:45:16.669386 20922 ts_tablet_manager.cc:1428] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.669391 20920 ts_tablet_manager.cc:1428] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.669528 20926 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.669574 20927 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.669648 20926 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:45:16.669677 20927 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:45:16.705578 20938 raft_consensus.cc:482] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:45:16.705680 20938 raft_consensus.cc:504] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.705876 20938 leader_election.cc:288] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:16.706048 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26cd2fa9a794c2ca91d2f2350d54f66" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8" is_pre_election: true
I20260619 02:45:16.706069 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26cd2fa9a794c2ca91d2f2350d54f66" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" is_pre_election: true
I20260619 02:45:16.706144 20566 raft_consensus.cc:2454] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:16.706146 20706 raft_consensus.cc:2454] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:16.706279 20778 leader_election.cc:302] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33494be5f6e64e4c9737e0f079960c2a, d103d3563a8c4ff69bd702a6e0aee78c; no voters:
I20260619 02:45:16.706391 20938 raft_consensus.cc:2781] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:45:16.706434 20938 raft_consensus.cc:482] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:45:16.706462 20938 raft_consensus.cc:3037] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.707214 20938 raft_consensus.cc:504] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.707363 20938 leader_election.cc:288] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Requested vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:16.707487 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26cd2fa9a794c2ca91d2f2350d54f66" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
I20260619 02:45:16.707515 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a26cd2fa9a794c2ca91d2f2350d54f66" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8"
I20260619 02:45:16.707587 20566 raft_consensus.cc:3037] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.707585 20706 raft_consensus.cc:3037] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.708165 20566 raft_consensus.cc:2454] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:16.708214 20706 raft_consensus.cc:2454] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:16.708365 20778 leader_election.cc:302] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33494be5f6e64e4c9737e0f079960c2a, d103d3563a8c4ff69bd702a6e0aee78c; no voters:
I20260619 02:45:16.708465 20938 raft_consensus.cc:2781] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:16.708527 20938 raft_consensus.cc:686] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [term 1 LEADER]: Becoming Leader. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Running, Role: LEADER
I20260619 02:45:16.708593 20938 consensus_queue.cc:237] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.708894 20930 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: TxnStatusTablet state changed. Reason: New leader 33494be5f6e64e4c9737e0f079960c2a. Latest consensus state: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.708985 20930 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:45:16.709182 20962 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 02:45:16.709302 20962 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 02:45:16.709353 20409 catalog_manager.cc:5495] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67). New cstate: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260619 02:45:16.717228 20957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.714514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42597 (local address 127.0.0.1:42226)
0619 02:45:16.714592 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.714604 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.714650 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.714819 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.714819 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.714820 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:45:16.714860 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.714862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.715738 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.715738 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.716283 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.716317 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.716767 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.716768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.716839 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.716858 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.717064 (+ 206us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.717068 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.717103 (+ 35us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.717158 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260619 02:45:16.717223 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.714587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42226 (local address 127.12.145.67:42597)
0619 02:45:16.714627 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.714629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.714638 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:16.714727 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.714728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.714738 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.714813 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:16.714899 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.715666 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.716400 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.716695 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.716770 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.716959 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.716992 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.717044 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.717106 (+ 62us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.717124 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:45:16.718098 20566 raft_consensus.cc:1261] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.718091 20706 raft_consensus.cc:1261] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.718304 20930 consensus_queue.cc:1035] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.718397 20938 consensus_queue.cc:1035] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.718916 20927 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: TxnStatusTablet state changed. Reason: New leader 33494be5f6e64e4c9737e0f079960c2a. Latest consensus state: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.719005 20927 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:45:16.719205 20926 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: TxnStatusTablet state changed. Reason: New leader 33494be5f6e64e4c9737e0f079960c2a. Latest consensus state: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.719297 20926 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:45:16.719911 20938 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.719990 20938 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:45:16.720237 20928 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.720314 20928 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P 33494be5f6e64e4c9737e0f079960c2a: This TxnStatusTablet replica's current role is: LEADER
I20260619 02:45:16.720655 20927 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.720745 20927 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P d103d3563a8c4ff69bd702a6e0aee78c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:45:16.721282 20926 tablet_replica.cc:439] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } } }
I20260619 02:45:16.721361 20926 tablet_replica.cc:442] T a26cd2fa9a794c2ca91d2f2350d54f66 P 272c8bee4b374f92acfd2bbca34630a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 02:45:16.723917 20919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.721450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54518 (local address 127.12.145.66:46635)
0619 02:45:16.721486 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.721488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.721495 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:45:16.721528 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.721529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.721549 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.721617 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:16.721739 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.722191 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.723134 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.723363 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.723449 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.723598 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.723700 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.723777 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.723826 (+ 49us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.723845 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:45:16.730629 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.728067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:42681 (local address 127.12.145.67:42597)
0619 02:45:16.728112 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.728113 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.728219 (+ 106us) server_negotiation.cc:407] Connection header received
0619 02:45:16.728276 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.728277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.728286 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.728342 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:16.728465 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.728888 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.729966 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.730133 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.730176 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.730367 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.730390 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.730423 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.730498 (+ 75us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.730514 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:45:16.730829 20968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.727970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42597 (local address 127.12.145.66:42681)
0619 02:45:16.728148 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.728160 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.728219 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.728356 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.728357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.728358 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:45:16.728412 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.728413 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.728956 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.728956 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.729885 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.729887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.730211 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.730212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.730273 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.730287 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.730442 (+ 155us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.730443 (+ 1us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.730496 (+ 53us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.730534 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
I20260619 02:45:16.733036 20566 raft_consensus.cc:1261] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Refusing update from remote peer 272c8bee4b374f92acfd2bbca34630a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.733110 20846 raft_consensus.cc:1261] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Refusing update from remote peer 272c8bee4b374f92acfd2bbca34630a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.733347 20926 consensus_queue.cc:1035] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.733512 20926 consensus_queue.cc:1035] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.741935 20919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.739352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:55411 (local address 127.12.145.66:46635)
0619 02:45:16.739414 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.739416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.739425 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:16.739444 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.739444 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.739457 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.739535 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:16.739608 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.740322 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.741260 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.741538 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.741619 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.741723 (+ 104us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.741758 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.741804 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.741857 (+ 53us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.741874 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260619 02:45:16.741991 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.739164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:46635 (local address 127.12.145.67:55411)
0619 02:45:16.739240 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:16.739251 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:16.739295 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:16.739538 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:16.739538 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:16.739539 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:45:16.739571 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.739572 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.740426 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.740427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.741187 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:16.741190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.741619 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.741619 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:16.741658 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.741669 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.741819 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.741821 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:45:16.741854 (+ 33us) client_negotiation.cc:240] Negotiation successful
0619 02:45:16.741904 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260619 02:45:16.750787 20407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:16.750883 20407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:16.751540 20407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Sending DeleteTablet for 3 replicas of tablet 16c37b526f434861bd4702e607978097
I20260619 02:45:16.751786 20826 tablet_service.cc:1514] Processing DeleteTablet for tablet 16c37b526f434861bd4702e607978097 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:42210
I20260619 02:45:16.751885 20943 tablet_replica.cc:330] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: stopping tablet replica
I20260619 02:45:16.751931 20546 tablet_service.cc:1514] Processing DeleteTablet for tablet 16c37b526f434861bd4702e607978097 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:40176
I20260619 02:45:16.751955 20943 raft_consensus.cc:2229] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:16.751988 20943 raft_consensus.cc:2258] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.752025 20686 tablet_service.cc:1514] Processing DeleteTablet for tablet 16c37b526f434861bd4702e607978097 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:54506
I20260619 02:45:16.752043 20944 tablet_replica.cc:330] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: stopping tablet replica
I20260619 02:45:16.752094 20944 raft_consensus.cc:2229] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:16.752097 20945 tablet_replica.cc:330] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: stopping tablet replica
I20260619 02:45:16.752128 20944 raft_consensus.cc:2258] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.752142 20945 raft_consensus.cc:2229] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:45:16.752225 20945 raft_consensus.cc:2258] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.752539 20943 ts_tablet_manager.cc:1905] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.754169 20943 ts_tablet_manager.cc:1918] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:45:16.754220 20943 log.cc:1196] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/16c37b526f434861bd4702e607978097
I20260619 02:45:16.754443 20943 ts_tablet_manager.cc:1939] T 16c37b526f434861bd4702e607978097 P 33494be5f6e64e4c9737e0f079960c2a: Deleting consensus metadata
I20260619 02:45:16.754921 20945 ts_tablet_manager.cc:1905] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.754930 20395 catalog_manager.cc:4841] TS 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67:42597): tablet 16c37b526f434861bd4702e607978097 (table test-table [id=833f266dc5f34045a86f0c1a035ca8aa]) successfully deleted
I20260619 02:45:16.756408 20945 ts_tablet_manager.cc:1918] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:45:16.756456 20945 log.cc:1196] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/16c37b526f434861bd4702e607978097
I20260619 02:45:16.756656 20945 ts_tablet_manager.cc:1939] T 16c37b526f434861bd4702e607978097 P 272c8bee4b374f92acfd2bbca34630a8: Deleting consensus metadata
I20260619 02:45:16.757223 20396 catalog_manager.cc:4841] TS 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635): tablet 16c37b526f434861bd4702e607978097 (table test-table [id=833f266dc5f34045a86f0c1a035ca8aa]) successfully deleted
I20260619 02:45:16.757292 20944 ts_tablet_manager.cc:1905] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.758728 20944 ts_tablet_manager.cc:1918] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:45:16.758791 20944 log.cc:1196] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/16c37b526f434861bd4702e607978097
I20260619 02:45:16.758989 20944 ts_tablet_manager.cc:1939] T 16c37b526f434861bd4702e607978097 P d103d3563a8c4ff69bd702a6e0aee78c: Deleting consensus metadata
I20260619 02:45:16.759552 20394 catalog_manager.cc:4841] TS d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651): tablet 16c37b526f434861bd4702e607978097 (table test-table [id=833f266dc5f34045a86f0c1a035ca8aa]) successfully deleted
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 02:45:16.786306 20459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:16.779673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.12.145.126:37973)
0619 02:45:16.779724 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.779726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.779872 (+ 146us) server_negotiation.cc:407] Connection header received
0619 02:45:16.779933 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.779934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.779946 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.780006 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.780692 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.781394 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.782515 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.782838 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.782909 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.786196 (+ 3287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34992: BlockingRecv error: recv got EOF from 127.0.0.1:34992 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Jun 19 02:45:16 dist-test-slave-fbl4 krb5kdc[20364](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM
I20260619 02:45:16.799072 20459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.787383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35008 (local address 127.12.145.126:37973)
0619 02:45:16.787425 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.787427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.790719 (+ 3292us) server_negotiation.cc:407] Connection header received
0619 02:45:16.790773 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.790774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.790784 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.790837 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:16.791382 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.792146 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.793097 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.793389 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.793459 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.796152 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:16.796153 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:16.796153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:16.796160 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:16.797839 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.798261 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.798262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.798263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.798325 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:16.798534 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:16.798534 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:16.798535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:16.798688 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:16.798806 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.798912 (+ 106us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.798984 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:45:16.800940 20407 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:45:16.801132 20407 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:45:16.802435 20546 tablet_service.cc:1467] Processing CreateTablet for tablet 48a7c646425e46d8b482ee79e78d5b84 (DEFAULT_TABLE table=test-table [id=6f4ba6d1db6c4a05b8e6b8453daed842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.802623 20546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48a7c646425e46d8b482ee79e78d5b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.803930 20922 tablet_bootstrap.cc:492] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: Bootstrap starting.
I20260619 02:45:16.804322 20922 tablet_bootstrap.cc:654] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.804762 20826 tablet_service.cc:1467] Processing CreateTablet for tablet 48a7c646425e46d8b482ee79e78d5b84 (DEFAULT_TABLE table=test-table [id=6f4ba6d1db6c4a05b8e6b8453daed842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.804898 20826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48a7c646425e46d8b482ee79e78d5b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.806137 20921 tablet_bootstrap.cc:492] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: Bootstrap starting.
I20260619 02:45:16.806434 20921 tablet_bootstrap.cc:654] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.807163 20686 tablet_service.cc:1467] Processing CreateTablet for tablet 48a7c646425e46d8b482ee79e78d5b84 (DEFAULT_TABLE table=test-table [id=6f4ba6d1db6c4a05b8e6b8453daed842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.807287 20686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48a7c646425e46d8b482ee79e78d5b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.808528 20920 tablet_bootstrap.cc:492] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: Bootstrap starting.
I20260619 02:45:16.808933 20920 tablet_bootstrap.cc:654] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.809459 20921 tablet_bootstrap.cc:492] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: No bootstrap required, opened a new log
I20260619 02:45:16.809510 20921 ts_tablet_manager.cc:1397] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260619 02:45:16.809633 20921 raft_consensus.cc:348] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.809702 20921 raft_consensus.cc:374] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.809723 20921 raft_consensus.cc:729] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.809763 20921 consensus_queue.cc:260] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.809844 20921 ts_tablet_manager.cc:1428] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.810262 20922 tablet_bootstrap.cc:492] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: No bootstrap required, opened a new log
I20260619 02:45:16.810334 20922 ts_tablet_manager.cc:1397] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260619 02:45:16.811033 20920 tablet_bootstrap.cc:492] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: No bootstrap required, opened a new log
I20260619 02:45:16.811084 20920 ts_tablet_manager.cc:1397] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260619 02:45:16.811206 20920 raft_consensus.cc:348] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.811277 20920 raft_consensus.cc:374] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.811309 20920 raft_consensus.cc:729] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 272c8bee4b374f92acfd2bbca34630a8, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.811354 20920 consensus_queue.cc:260] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.811437 20920 ts_tablet_manager.cc:1428] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.810491 20922 raft_consensus.cc:348] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.811744 20922 raft_consensus.cc:374] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.811776 20922 raft_consensus.cc:729] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d103d3563a8c4ff69bd702a6e0aee78c, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.811815 20922 consensus_queue.cc:260] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.811895 20922 ts_tablet_manager.cc:1428] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:45:16.866005 20938 raft_consensus.cc:482] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:45:16.866102 20938 raft_consensus.cc:504] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.866276 20938 leader_election.cc:288] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:16.866496 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48a7c646425e46d8b482ee79e78d5b84" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8" is_pre_election: true
I20260619 02:45:16.866760 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48a7c646425e46d8b482ee79e78d5b84" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" is_pre_election: true
I20260619 02:45:16.866848 20566 raft_consensus.cc:2454] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:16.866640 20706 raft_consensus.cc:2454] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:16.867049 20778 leader_election.cc:302] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33494be5f6e64e4c9737e0f079960c2a, d103d3563a8c4ff69bd702a6e0aee78c; no voters:
I20260619 02:45:16.867138 20938 raft_consensus.cc:2781] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:45:16.867183 20938 raft_consensus.cc:482] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:45:16.867223 20938 raft_consensus.cc:3037] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.868160 20938 raft_consensus.cc:504] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.868287 20938 leader_election.cc:288] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Requested vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:16.868521 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48a7c646425e46d8b482ee79e78d5b84" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8"
I20260619 02:45:16.868532 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48a7c646425e46d8b482ee79e78d5b84" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
I20260619 02:45:16.868600 20706 raft_consensus.cc:3037] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.868629 20566 raft_consensus.cc:3037] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:16.869352 20706 raft_consensus.cc:2454] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:16.869423 20566 raft_consensus.cc:2454] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:16.869513 20780 leader_election.cc:302] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 272c8bee4b374f92acfd2bbca34630a8, 33494be5f6e64e4c9737e0f079960c2a; no voters:
I20260619 02:45:16.869606 20938 raft_consensus.cc:2781] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:16.869658 20938 raft_consensus.cc:686] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 1 LEADER]: Becoming Leader. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Running, Role: LEADER
I20260619 02:45:16.869700 20938 consensus_queue.cc:237] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.870211 20407 catalog_manager.cc:5495] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67). New cstate: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260619 02:45:16.887169 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:16.884821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42236 (local address 127.12.145.67:42597)
0619 02:45:16.884885 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:16.884887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:16.884896 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:16.884954 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:16.884955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:16.884963 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:16.885008 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:16.885149 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.885620 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.886424 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:16.886675 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:16.886749 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:16.886910 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:16.886959 (+ 49us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:16.887016 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:16.887076 (+ 60us) server_negotiation.cc:299] Negotiation successful
0619 02:45:16.887093 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:45:16.887861 20706 raft_consensus.cc:1261] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.887892 20566 raft_consensus.cc:1261] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:16.888099 20928 consensus_queue.cc:1035] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.888245 20938 consensus_queue.cc:1035] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:16.889407 20933 mvcc.cc:205] Tried to move back new op lower bound from 7298404830771236864 to 7298404830698680320. Current Snapshot: MvccSnapshot[applied={T|T < 7298404830771236864}]
I20260619 02:45:16.890671 20407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:16.890756 20407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:16.891327 20407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Sending DeleteTablet for 3 replicas of tablet 48a7c646425e46d8b482ee79e78d5b84
I20260619 02:45:16.891582 20686 tablet_service.cc:1514] Processing DeleteTablet for tablet 48a7c646425e46d8b482ee79e78d5b84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:54506
I20260619 02:45:16.891580 20546 tablet_service.cc:1514] Processing DeleteTablet for tablet 48a7c646425e46d8b482ee79e78d5b84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:40176
I20260619 02:45:16.891680 20944 tablet_replica.cc:330] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: stopping tablet replica
I20260619 02:45:16.891685 20826 tablet_service.cc:1514] Processing DeleteTablet for tablet 48a7c646425e46d8b482ee79e78d5b84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:16 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:42210
I20260619 02:45:16.891752 20944 raft_consensus.cc:2229] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:16.891782 20943 tablet_replica.cc:330] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: stopping tablet replica
I20260619 02:45:16.891799 20944 raft_consensus.cc:2258] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.891844 20943 raft_consensus.cc:2229] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:45:16.891868 20945 tablet_replica.cc:330] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: stopping tablet replica
I20260619 02:45:16.891909 20943 raft_consensus.cc:2258] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.891932 20945 raft_consensus.cc:2229] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:16.891980 20945 raft_consensus.cc:2258] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:16.892194 20944 ts_tablet_manager.cc:1905] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.892172 20407 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 02:45:16.892302 20945 ts_tablet_manager.cc:1905] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 02:45:16.892325 20407 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:45:16.893774 20943 ts_tablet_manager.cc:1905] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:16.893862 20944 ts_tablet_manager.cc:1918] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:45:16.893918 20944 log.cc:1196] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/48a7c646425e46d8b482ee79e78d5b84
I20260619 02:45:16.894135 20944 ts_tablet_manager.cc:1939] T 48a7c646425e46d8b482ee79e78d5b84 P d103d3563a8c4ff69bd702a6e0aee78c: Deleting consensus metadata
I20260619 02:45:16.894446 20394 catalog_manager.cc:4841] TS d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651): tablet 48a7c646425e46d8b482ee79e78d5b84 (table test-table [id=6f4ba6d1db6c4a05b8e6b8453daed842]) successfully deleted
I20260619 02:45:16.894825 20546 tablet_service.cc:1467] Processing CreateTablet for tablet 0b74d5b2b1b944058bcf18f4a81b361b (DEFAULT_TABLE table=test-table [id=35c3b2fa20e049a980139da9a8cc7d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.894867 20826 tablet_service.cc:1467] Processing CreateTablet for tablet 0b74d5b2b1b944058bcf18f4a81b361b (DEFAULT_TABLE table=test-table [id=35c3b2fa20e049a980139da9a8cc7d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.894933 20546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b74d5b2b1b944058bcf18f4a81b361b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.894945 20826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b74d5b2b1b944058bcf18f4a81b361b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.895342 20943 ts_tablet_manager.cc:1918] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:45:16.895419 20943 log.cc:1196] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/48a7c646425e46d8b482ee79e78d5b84
I20260619 02:45:16.895624 20943 ts_tablet_manager.cc:1939] T 48a7c646425e46d8b482ee79e78d5b84 P 33494be5f6e64e4c9737e0f079960c2a: Deleting consensus metadata
I20260619 02:45:16.896147 20922 tablet_bootstrap.cc:492] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c: Bootstrap starting.
I20260619 02:45:16.896168 20921 tablet_bootstrap.cc:492] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: Bootstrap starting.
I20260619 02:45:16.896437 20921 tablet_bootstrap.cc:654] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.896495 20922 tablet_bootstrap.cc:654] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.896679 20395 catalog_manager.cc:4841] TS 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67:42597): tablet 48a7c646425e46d8b482ee79e78d5b84 (table test-table [id=6f4ba6d1db6c4a05b8e6b8453daed842]) successfully deleted
I20260619 02:45:16.896801 20686 tablet_service.cc:1467] Processing CreateTablet for tablet 0b74d5b2b1b944058bcf18f4a81b361b (DEFAULT_TABLE table=test-table [id=35c3b2fa20e049a980139da9a8cc7d4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:16.897107 20921 tablet_bootstrap.cc:492] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: No bootstrap required, opened a new log
I20260619 02:45:16.897161 20921 ts_tablet_manager.cc:1397] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260619 02:45:16.897264 20921 raft_consensus.cc:348] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.897342 20921 raft_consensus.cc:374] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.897367 20921 raft_consensus.cc:729] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.897423 20922 tablet_bootstrap.cc:492] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c: No bootstrap required, opened a new log
I20260619 02:45:16.897429 20921 consensus_queue.cc:260] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.897471 20922 ts_tablet_manager.cc:1397] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260619 02:45:16.897519 20921 ts_tablet_manager.cc:1428] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260619 02:45:16.897616 20922 raft_consensus.cc:348] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.897704 20922 raft_consensus.cc:374] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.897718 20945 ts_tablet_manager.cc:1918] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:45:16.897727 20922 raft_consensus.cc:729] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d103d3563a8c4ff69bd702a6e0aee78c, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.897764 20945 log.cc:1196] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/48a7c646425e46d8b482ee79e78d5b84
I20260619 02:45:16.897773 20922 consensus_queue.cc:260] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.897863 20922 ts_tablet_manager.cc:1428] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:16.897972 20945 ts_tablet_manager.cc:1939] T 48a7c646425e46d8b482ee79e78d5b84 P 272c8bee4b374f92acfd2bbca34630a8: Deleting consensus metadata
I20260619 02:45:16.898160 20686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b74d5b2b1b944058bcf18f4a81b361b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:16.898459 20396 catalog_manager.cc:4841] TS 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635): tablet 48a7c646425e46d8b482ee79e78d5b84 (table test-table [id=6f4ba6d1db6c4a05b8e6b8453daed842]) successfully deleted
I20260619 02:45:16.899187 20920 tablet_bootstrap.cc:492] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: Bootstrap starting.
I20260619 02:45:16.899469 20920 tablet_bootstrap.cc:654] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:16.899962 20920 tablet_bootstrap.cc:492] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: No bootstrap required, opened a new log
I20260619 02:45:16.900022 20920 ts_tablet_manager.cc:1397] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260619 02:45:16.900120 20920 raft_consensus.cc:348] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.900198 20920 raft_consensus.cc:374] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:16.900228 20920 raft_consensus.cc:729] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 272c8bee4b374f92acfd2bbca34630a8, State: Initialized, Role: FOLLOWER
I20260619 02:45:16.900308 20920 consensus_queue.cc:260] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:16.900399 20920 ts_tablet_manager.cc:1428] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:17.125312 20938 raft_consensus.cc:482] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:45:17.125401 20938 raft_consensus.cc:504] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:17.125610 20938 leader_election.cc:288] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:17.125946 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b74d5b2b1b944058bcf18f4a81b361b" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8" is_pre_election: true
I20260619 02:45:17.125946 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b74d5b2b1b944058bcf18f4a81b361b" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" is_pre_election: true
I20260619 02:45:17.126044 20706 raft_consensus.cc:2454] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:17.126044 20566 raft_consensus.cc:2454] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 0.
I20260619 02:45:17.126200 20780 leader_election.cc:302] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 272c8bee4b374f92acfd2bbca34630a8, 33494be5f6e64e4c9737e0f079960c2a; no voters:
I20260619 02:45:17.126365 20938 raft_consensus.cc:2781] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:45:17.126420 20938 raft_consensus.cc:482] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:45:17.126466 20938 raft_consensus.cc:3037] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:17.127149 20938 raft_consensus.cc:504] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:17.127291 20938 leader_election.cc:288] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Requested vote from peers d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651), 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635)
I20260619 02:45:17.127440 20566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b74d5b2b1b944058bcf18f4a81b361b" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d103d3563a8c4ff69bd702a6e0aee78c"
I20260619 02:45:17.127508 20566 raft_consensus.cc:3037] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:17.127455 20706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b74d5b2b1b944058bcf18f4a81b361b" candidate_uuid: "33494be5f6e64e4c9737e0f079960c2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "272c8bee4b374f92acfd2bbca34630a8"
I20260619 02:45:17.127568 20706 raft_consensus.cc:3037] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:17.128096 20566 raft_consensus.cc:2454] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:17.128204 20706 raft_consensus.cc:2454] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33494be5f6e64e4c9737e0f079960c2a in term 1.
I20260619 02:45:17.128254 20778 leader_election.cc:302] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33494be5f6e64e4c9737e0f079960c2a, d103d3563a8c4ff69bd702a6e0aee78c; no voters:
I20260619 02:45:17.128347 20938 raft_consensus.cc:2781] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:17.128424 20938 raft_consensus.cc:686] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 1 LEADER]: Becoming Leader. State: Replica: 33494be5f6e64e4c9737e0f079960c2a, State: Running, Role: LEADER
I20260619 02:45:17.128468 20938 consensus_queue.cc:237] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } }
I20260619 02:45:17.129055 20409 catalog_manager.cc:5495] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67). New cstate: current_term: 1 leader_uuid: "33494be5f6e64e4c9737e0f079960c2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33494be5f6e64e4c9737e0f079960c2a" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42597 } health_report { overall_health: HEALTHY } } }
I20260619 02:45:17.185957 20918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:17.183869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:43823 (local address 127.12.145.67:42597)
0619 02:45:17.183929 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:17.183930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:17.183938 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:17.183957 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:17.183969 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:17.183978 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:17.184021 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:17.184121 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:17.184582 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:17.185270 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:17.185479 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:17.185550 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:17.185695 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:17.185731 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:17.185791 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:17.185850 (+ 59us) server_negotiation.cc:299] Negotiation successful
0619 02:45:17.185865 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":40}
I20260619 02:45:17.185966 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:17.183785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42597 (local address 127.12.145.67:43823)
0619 02:45:17.183845 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:17.183857 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:17.183897 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:17.184021 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:17.184022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:17.184023 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 02:45:17.184077 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:17.184078 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:17.184661 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:17.184662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:17.185174 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:17.185176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:17.185558 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:17.185559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:17.185608 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:17.185611 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 02:45:17.185791 (+ 180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 02:45:17.185793 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:45:17.185845 (+ 52us) client_negotiation.cc:240] Negotiation successful
0619 02:45:17.185885 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":2}
I20260619 02:45:17.187698 20706 raft_consensus.cc:1261] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:17.187698 20566 raft_consensus.cc:1261] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Refusing update from remote peer 33494be5f6e64e4c9737e0f079960c2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:17.187917 20928 consensus_queue.cc:1035] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d103d3563a8c4ff69bd702a6e0aee78c" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:17.188030 20938 consensus_queue.cc:1035] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "272c8bee4b374f92acfd2bbca34630a8" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 46635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:17.197427 20407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:17.197512 20407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:17.198088 20407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91a30bb60a80407b96e86e88603f92ca: Sending DeleteTablet for 3 replicas of tablet 0b74d5b2b1b944058bcf18f4a81b361b
I20260619 02:45:17.198311 20826 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b74d5b2b1b944058bcf18f4a81b361b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:17 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:42210
I20260619 02:45:17.198312 20686 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b74d5b2b1b944058bcf18f4a81b361b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:17 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:54506
I20260619 02:45:17.198397 20943 tablet_replica.cc:330] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: stopping tablet replica
I20260619 02:45:17.198378 20546 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b74d5b2b1b944058bcf18f4a81b361b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:17 UTC) from {username='oryx', principal='oryx/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:40176
I20260619 02:45:17.198447 20943 raft_consensus.cc:2229] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:45:17.198474 20944 tablet_replica.cc:330] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c: stopping tablet replica
I20260619 02:45:17.198482 20945 tablet_replica.cc:330] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: stopping tablet replica
I20260619 02:45:17.198500 20943 raft_consensus.cc:2258] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:17.198521 20944 raft_consensus.cc:2229] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:17.198585 20944 raft_consensus.cc:2258] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:17.198527 20945 raft_consensus.cc:2229] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:17.198688 20945 raft_consensus.cc:2258] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:17.198832 20944 ts_tablet_manager.cc:1905] T 0b74d5b2b1b944058bcf18f4a81b361b P d103d3563a8c4ff69bd702a6e0aee78c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:17.198964 20943 ts_tablet_manager.cc:1905] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:17.198984 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 20481
I20260619 02:45:17.200202 20945 ts_tablet_manager.cc:1905] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:17.200451 20943 ts_tablet_manager.cc:1918] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:45:17.200505 20943 log.cc:1196] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/0b74d5b2b1b944058bcf18f4a81b361b
I20260619 02:45:17.200721 20943 ts_tablet_manager.cc:1939] T 0b74d5b2b1b944058bcf18f4a81b361b P 33494be5f6e64e4c9737e0f079960c2a: Deleting consensus metadata
I20260619 02:45:17.201035 20395 catalog_manager.cc:4841] TS 33494be5f6e64e4c9737e0f079960c2a (127.12.145.67:42597): tablet 0b74d5b2b1b944058bcf18f4a81b361b (table test-table [id=35c3b2fa20e049a980139da9a8cc7d4a]) successfully deleted
I20260619 02:45:17.201623 20945 ts_tablet_manager.cc:1918] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 02:45:17.201678 20945 log.cc:1196] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/0b74d5b2b1b944058bcf18f4a81b361b
I20260619 02:45:17.201892 20945 ts_tablet_manager.cc:1939] T 0b74d5b2b1b944058bcf18f4a81b361b P 272c8bee4b374f92acfd2bbca34630a8: Deleting consensus metadata
I20260619 02:45:17.202296 20396 catalog_manager.cc:4841] TS 272c8bee4b374f92acfd2bbca34630a8 (127.12.145.66:46635): tablet 0b74d5b2b1b944058bcf18f4a81b361b (table test-table [id=35c3b2fa20e049a980139da9a8cc7d4a]) successfully deleted
W20260619 02:45:17.205345 20394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:37651 (error 108)
I20260619 02:45:17.205555 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 20621
I20260619 02:45:17.206288 21002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:17.205659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:37651 (local address 127.0.0.1:40182)
0619 02:45:17.206181 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:17.206233 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:37651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":35,"threads_started":1}
W20260619 02:45:17.206420 20394 catalog_manager.cc:4584] TS d103d3563a8c4ff69bd702a6e0aee78c (127.12.145.65:37651): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0b74d5b2b1b944058bcf18f4a81b361b: Network error: Client connection negotiation failed: client connection to 127.12.145.65:37651: connect: Connection refused (error 111)
I20260619 02:45:17.211997 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 20761
I20260619 02:45:17.217801 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 20377
2026-06-19T02:45:17Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2778 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:45:17 dist-test-slave-fbl4 krb5kdc[21005](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:45:17 dist-test-slave-fbl4 krb5kdc[21005](info): set up 2 sockets
Jun 19 02:45:17 dist-test-slave-fbl4 krb5kdc[21005](info): commencing operation
krb5kdc: starting...
W20260619 02:45:18.255062 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:45:18 dist-test-slave-fbl4 krb5kdc[21005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:45:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:45:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:45:18.369773 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34531
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:34821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:18.447264 21018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:18.447449 21018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:18.447469 21018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:18.448632 21018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:45:18.448668 21018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:18.448683 21018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:18.448694 21018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:45:18.448706 21018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:45:18.450098 21018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:18.450304 21018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:18.450460 21018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:18.454952 21024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:18.454941 21023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:18.454926 21026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:18.455186 21018 server_base.cc:1034] running on GCE node
I20260619 02:45:18.455435 21018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:18.455701 21018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:18.456825 21018 hybrid_clock.cc:648] HybridClock initialized: now 1781837118456815 us; error 27 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-06-19T02:45:18Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1237 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:45:18 dist-test-slave-fbl4 krb5kdc[21031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:45:18 dist-test-slave-fbl4 krb5kdc[21031](info): set up 2 sockets
Jun 19 02:45:18 dist-test-slave-fbl4 krb5kdc[21031](info): commencing operation
krb5kdc: starting...
W20260619 02:45:19.483086 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.001s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:45:19 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:45:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:45:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:45:19.595240 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:32987
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:32987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:19.673561 21044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:19.673754 21044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:19.673776 21044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:19.674959 21044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:45:19.674999 21044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:19.675014 21044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:19.675026 21044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:45:19.675081 21044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:45:19.676481 21044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:32987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:32987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:19.676715 21044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:19.676947 21044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:19.681533 21050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:19.681533 21049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:19.681530 21052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:19.681804 21044 server_base.cc:1034] running on GCE node
I20260619 02:45:19.682036 21044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:19.682319 21044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:19.683475 21044 hybrid_clock.cc:648] HybridClock initialized: now 1781837119683461 us; error 42 us; skew 500 ppm
Jun 19 02:45:19 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837119, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:19.685760 21044 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:45:19.686205 21044 webserver.cc:460] Webserver started at http://127.12.145.126:38355/ using document root <none> and password file <none>
I20260619 02:45:19.686424 21044 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:19.686491 21044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:19.686640 21044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:19.687637 21044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "c9e2a3b92e564343ad12233c4e31f3f7"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "1939db3f2c8e4c6b1e9a3ba08fb28e6d"
server_key_iv: "bc3921e4e3f8a010ec105495ca7ec85b"
server_key_version: "encryptionkey@0"
I20260619 02:45:19.687994 21044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "c9e2a3b92e564343ad12233c4e31f3f7"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "1939db3f2c8e4c6b1e9a3ba08fb28e6d"
server_key_iv: "bc3921e4e3f8a010ec105495ca7ec85b"
server_key_version: "encryptionkey@0"
I20260619 02:45:19.689257 21044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:45:19.689926 21059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:19.690085 21044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:19.690181 21044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "c9e2a3b92e564343ad12233c4e31f3f7"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "1939db3f2c8e4c6b1e9a3ba08fb28e6d"
server_key_iv: "bc3921e4e3f8a010ec105495ca7ec85b"
server_key_version: "encryptionkey@0"
I20260619 02:45:19.690266 21044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:19.701840 21044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:19.703694 21044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:19.703850 21044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:19.707804 21044 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:32987
I20260619 02:45:19.707840 21111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:32987 every 8 connection(s)
I20260619 02:45:19.708185 21044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:45:19.708990 21112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:19.709263 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21044
I20260619 02:45:19.709388 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:45:19.709574 12869 external_mini_cluster.cc:1428] Setting key 3313f11506a4664134b0118aa598a447
I20260619 02:45:19.712623 21112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Bootstrap starting.
I20260619 02:45:19.713292 21112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:19.713613 21112 log.cc:824] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:19.714363 21112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: No bootstrap required, opened a new log
I20260619 02:45:19.716240 21112 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:19.716374 21112 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Jun 19 02:45:19 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:45:19.716396 21112 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9e2a3b92e564343ad12233c4e31f3f7, State: Initialized, Role: FOLLOWER
I20260619 02:45:19.716527 21112 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:19.716607 21112 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:45:19.716629 21112 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:45:19.716694 21112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:19.717206 21112 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:19.717319 21112 leader_election.cc:302] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9e2a3b92e564343ad12233c4e31f3f7; no voters:
I20260619 02:45:19.717507 21112 leader_election.cc:288] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:45:19.717585 21117 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:19.717741 21117 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9e2a3b92e564343ad12233c4e31f3f7, State: Running, Role: LEADER
I20260619 02:45:19.717785 21112 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:45:19.718122 21117 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:19.718532 21118 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } } }
I20260619 02:45:19.718631 21118 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:19.718581 21119 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9e2a3b92e564343ad12233c4e31f3f7. Latest consensus state: current_term: 1 leader_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } } }
I20260619 02:45:19.718673 21119 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:19.718907 21121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:45:19.719482 21121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:45:19.720789 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:19.710184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57124 (local address 127.12.145.126:32987)
0619 02:45:19.710351 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:19.710360 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:19.710392 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:45:19.710922 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:19.710930 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:19.710994 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:19.711156 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:19.711771 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:19.713150 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:19.713970 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:19.714465 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:19.714598 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:19.716972 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:19.716983 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:19.716983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:19.716994 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:19.719105 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:19.719507 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:19.719510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:19.719510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:19.719623 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:19.719867 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:19.719868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:19.719869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:19.720189 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:19.720341 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:19.720463 (+ 122us) server_negotiation.cc:299] Negotiation successful
0619 02:45:19.720599 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260619 02:45:19.721555 21121 catalog_manager.cc:1347] Generated new cluster ID: 32c996c2700f40628897bc1306174a47
I20260619 02:45:19.721606 21121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:45:19.739207 21121 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:45:19.739725 21121 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:45:19.745044 21121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Generated new TSK 0
I20260619 02:45:19.745237 21121 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:45:19.774896 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:32987
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:19.854153 21138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:19.854346 21138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:19.854367 21138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:19.855522 21138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:19.855563 21138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:19.855589 21138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:45:19.857046 21138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:19.857234 21138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:19.857470 21138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:19.862490 21146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:19.862457 21144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:19.862464 21143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:19.862519 21138 server_base.cc:1034] running on GCE node
I20260619 02:45:19.862834 21138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:19.863055 21138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:19.864217 21138 hybrid_clock.cc:648] HybridClock initialized: now 1781837119864207 us; error 31 us; skew 500 ppm
Jun 19 02:45:19 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837119, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:19.866494 21138 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:45:19.866916 21138 webserver.cc:460] Webserver started at http://127.12.145.65:41317/ using document root <none> and password file <none>
I20260619 02:45:19.867133 21138 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:19.867199 21138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:19.867359 21138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:19.868345 21138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "c79bd7d54a874823a071b76180c9c068"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "ca891f9e008b77188f0e8bc612abe094"
server_key_iv: "8bd6af3f359282253cc35c943d6c3991"
server_key_version: "encryptionkey@0"
I20260619 02:45:19.868705 21138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "c79bd7d54a874823a071b76180c9c068"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "ca891f9e008b77188f0e8bc612abe094"
server_key_iv: "8bd6af3f359282253cc35c943d6c3991"
server_key_version: "encryptionkey@0"
I20260619 02:45:19.869930 21138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:45:19.870615 21153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:19.870781 21138 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:19.870874 21138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "c79bd7d54a874823a071b76180c9c068"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "ca891f9e008b77188f0e8bc612abe094"
server_key_iv: "8bd6af3f359282253cc35c943d6c3991"
server_key_version: "encryptionkey@0"
I20260619 02:45:19.870952 21138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:19.882427 21138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:19.884068 21138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:19.884218 21138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:19.884433 21138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:19.884713 21138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:19.884771 21138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:19.884810 21138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:19.884837 21138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:19.890275 21138 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:42213
I20260619 02:45:19.890338 21266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:42213 every 8 connection(s)
I20260619 02:45:19.890632 21138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:45:19 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837119, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:45:19.898985 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:19.891307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:56101 (local address 127.12.145.126:32987)
0619 02:45:19.891345 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:19.891346 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:19.891535 (+ 189us) server_negotiation.cc:407] Connection header received
0619 02:45:19.891937 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:19.891938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:19.891948 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:19.891997 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:19.892979 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:19.893452 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:19.894477 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:19.894691 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:19.894753 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:19.896706 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:19.896707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:19.896708 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:19.896713 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:19.897852 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:19.898188 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:19.898188 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:19.898189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:19.898236 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:19.898431 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:19.898432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:19.898432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:19.898523 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:19.898640 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:19.898860 (+ 220us) server_negotiation.cc:299] Negotiation successful
0619 02:45:19.898923 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:45:19.899189 21269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:19.891303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:56101)
0619 02:45:19.891423 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:19.891452 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:19.891863 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:19.892044 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:19.892047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:19.892666 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:19.892906 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:19.892911 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:19.893566 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:19.893567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:19.894407 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:19.894409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:19.894761 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:19.894762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:19.894855 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:19.895348 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:19.895355 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:19.896633 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:19.897921 (+ 1288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:19.897927 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:19.897929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:19.898124 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:19.898292 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:19.898292 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:19.898293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:19.898379 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:19.898637 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:19.898641 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:19.898752 (+ 111us) client_negotiation.cc:769] Sending connection context
0619 02:45:19.898833 (+ 81us) client_negotiation.cc:240] Negotiation successful
0619 02:45:19.898936 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":70,"threads_started":1}
I20260619 02:45:19.899159 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21138
I20260619 02:45:19.899286 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:45:19.899526 12869 external_mini_cluster.cc:1428] Setting key e0a335b42aa15d32a524a1ec3881cabe
I20260619 02:45:19.899850 21267 heartbeater.cc:347] Connected to a master server at 127.12.145.126:32987
I20260619 02:45:19.899960 21267 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:19.900168 21267 heartbeater.cc:511] Master 127.12.145.126:32987 requested a full tablet report, sending...
I20260619 02:45:19.900687 21076 ts_manager.cc:194] Registered new tserver with Master: c79bd7d54a874823a071b76180c9c068 (127.12.145.65:42213)
I20260619 02:45:19.901294 21076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:56101
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:45:19.922711 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:32987
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:20.000927 21272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:20.001124 21272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:20.001148 21272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:20.002310 21272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:20.002351 21272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:20.002406 21272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:45:20.003805 21272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:20.004057 21272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:20.004281 21272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:20.009060 21278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.009073 21277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.009073 21280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.009297 21272 server_base.cc:1034] running on GCE node
I20260619 02:45:20.009523 21272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:20.009786 21272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:20.010946 21272 hybrid_clock.cc:648] HybridClock initialized: now 1781837120010933 us; error 26 us; skew 500 ppm
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:20.013288 21272 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:45:20.013687 21272 webserver.cc:460] Webserver started at http://127.12.145.66:43819/ using document root <none> and password file <none>
I20260619 02:45:20.013923 21272 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:20.013998 21272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:20.014147 21272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:20.015239 21272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "0cb8aa95417d4666af7ae677eb88baa4"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "3a708f8e1cec90012f0c61a516d11213"
server_key_iv: "a87da3299e8572b40e6fae9029bd01dd"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.015579 21272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "0cb8aa95417d4666af7ae677eb88baa4"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "3a708f8e1cec90012f0c61a516d11213"
server_key_iv: "a87da3299e8572b40e6fae9029bd01dd"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.016912 21272 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:45:20.017648 21287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.017835 21272 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:45:20.017932 21272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "0cb8aa95417d4666af7ae677eb88baa4"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "3a708f8e1cec90012f0c61a516d11213"
server_key_iv: "a87da3299e8572b40e6fae9029bd01dd"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.018008 21272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:20.026661 21272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:20.028352 21272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:20.028504 21272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:20.028714 21272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:20.028998 21272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:20.029049 21272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.029089 21272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:20.029114 21272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.034721 21272 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:38197
I20260619 02:45:20.034812 21400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:38197 every 8 connection(s)
I20260619 02:45:20.035097 21272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:45:20.036856 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21272
I20260619 02:45:20.036993 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:45:20.037222 12869 external_mini_cluster.cc:1428] Setting key 105aa5a436c6ba2b05264b8f3cfb3839
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
I20260619 02:45:20.044924 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.035807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:60711 (local address 127.12.145.126:32987)
0619 02:45:20.035870 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.035872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.036090 (+ 218us) server_negotiation.cc:407] Connection header received
0619 02:45:20.036565 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.036566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.036574 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.036630 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.037900 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.038403 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.039771 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.040079 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.040163 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.042160 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:20.042161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:20.042162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:20.042169 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:20.043563 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:20.043987 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:20.043988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:20.043989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:20.044047 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:20.044303 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:20.044304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:20.044304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:20.044417 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:20.044493 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:20.044759 (+ 266us) server_negotiation.cc:299] Negotiation successful
0619 02:45:20.044833 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:45:20.045109 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.035788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:60711)
0619 02:45:20.035952 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.035991 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.036482 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.036739 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.036743 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.037556 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.037810 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.037816 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.038493 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.038494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.039677 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.039680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.040171 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.040172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.040288 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.040806 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.040814 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.042067 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:20.043660 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:20.043666 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:20.043668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:20.043899 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:20.044113 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:20.044113 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:20.044114 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:20.044228 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:20.044484 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:20.044489 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:20.044626 (+ 137us) client_negotiation.cc:769] Sending connection context
0619 02:45:20.044731 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 02:45:20.044880 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260619 02:45:20.045703 21401 heartbeater.cc:347] Connected to a master server at 127.12.145.126:32987
I20260619 02:45:20.045787 21401 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:20.045958 21401 heartbeater.cc:511] Master 127.12.145.126:32987 requested a full tablet report, sending...
I20260619 02:45:20.046326 21076 ts_manager.cc:194] Registered new tserver with Master: 0cb8aa95417d4666af7ae677eb88baa4 (127.12.145.66:38197)
I20260619 02:45:20.046744 21076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:60711
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:45:20.060994 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:32987
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:20.139019 21406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:20.139200 21406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:20.139223 21406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:20.140312 21406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:20.140345 21406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:20.140370 21406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:45:20.141644 21406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:20.141819 21406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:20.141973 21406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:20.146504 21411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.146692 21406 server_base.cc:1034] running on GCE node
W20260619 02:45:20.146493 21414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.146481 21412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.147007 21406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:20.147274 21406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:20.148433 21406 hybrid_clock.cc:648] HybridClock initialized: now 1781837120148422 us; error 25 us; skew 500 ppm
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:20.150828 21406 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:45:20.151212 21406 webserver.cc:460] Webserver started at http://127.12.145.67:41657/ using document root <none> and password file <none>
I20260619 02:45:20.151423 21406 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:20.151487 21406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:20.151629 21406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:20.152566 21406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "d75005e404f142c8b5ea304f2d7bf79e"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "5ea32d4728828548b4e690d740e37d34"
server_key_iv: "08423593d854a4ae77bd63ef02345084"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.152912 21406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "d75005e404f142c8b5ea304f2d7bf79e"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "5ea32d4728828548b4e690d740e37d34"
server_key_iv: "08423593d854a4ae77bd63ef02345084"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.154129 21406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:45:20.154820 21421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.154973 21406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:45:20.155066 21406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "d75005e404f142c8b5ea304f2d7bf79e"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "5ea32d4728828548b4e690d740e37d34"
server_key_iv: "08423593d854a4ae77bd63ef02345084"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.155138 21406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:20.172528 21406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:20.174311 21406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:20.174470 21406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:20.174705 21406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:20.174991 21406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:20.175042 21406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.175081 21406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:20.175107 21406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.180425 21406 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:38871
I20260619 02:45:20.180513 21534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:38871 every 8 connection(s)
I20260619 02:45:20.180821 21406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:45:20.185256 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21406
I20260619 02:45:20.185379 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:45:20.185588 12869 external_mini_cluster.cc:1428] Setting key 7489076d02a8af629eccbafd6ac9571e
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:45:20.189229 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.181523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:52331 (local address 127.12.145.126:32987)
0619 02:45:20.181597 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.181599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.181743 (+ 144us) server_negotiation.cc:407] Connection header received
0619 02:45:20.182166 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.182167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.182176 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.182221 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.183102 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.183589 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.184505 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.184684 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.184743 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.186974 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:20.186975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:20.186975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:20.186982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:20.188155 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:20.188498 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:20.188498 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:20.188499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:20.188544 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:20.188751 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:20.188752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:20.188752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:20.188847 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:20.188896 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:20.189117 (+ 221us) server_negotiation.cc:299] Negotiation successful
0619 02:45:20.189171 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 02:45:20.189391 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.181474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:52331)
0619 02:45:20.181624 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.181656 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.182092 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.182276 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.182279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.182857 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.183030 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.183034 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.183665 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.183666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.184432 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.184434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.184751 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.184752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.184840 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.185283 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.185293 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.186886 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:20.188228 (+ 1342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:20.188233 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:20.188234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:20.188434 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:20.188600 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:20.188600 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:20.188600 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:20.188688 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:20.188899 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:20.188902 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:20.189003 (+ 101us) client_negotiation.cc:769] Sending connection context
0619 02:45:20.189093 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 02:45:20.189210 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260619 02:45:20.189771 21535 heartbeater.cc:347] Connected to a master server at 127.12.145.126:32987
I20260619 02:45:20.189888 21535 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:20.190074 21535 heartbeater.cc:511] Master 127.12.145.126:32987 requested a full tablet report, sending...
I20260619 02:45:20.190418 21076 ts_manager.cc:194] Registered new tserver with Master: d75005e404f142c8b5ea304f2d7bf79e (127.12.145.67:38871)
I20260619 02:45:20.190819 21076 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:52331
I20260619 02:45:20.197813 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab.
Entry for principal oryx/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab.
WARNING: no policy specified for oryx/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab.
Entry for principal oryx/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab.
WARNING: no policy specified for oryx/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab.
Entry for principal oryx/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab.
I20260619 02:45:20.258891 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21138
I20260619 02:45:20.262980 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21272
I20260619 02:45:20.267225 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21406
I20260619 02:45:20.271342 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21044
I20260619 02:45:20.277153 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:32987
--webserver_interface=127.12.145.126
--webserver_port=38355
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:32987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:20.355451 21544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:20.355644 21544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:20.355665 21544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:20.356711 21544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:45:20.356751 21544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:20.356765 21544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:20.356778 21544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:45:20.356791 21544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:45:20.358166 21544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:32987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:32987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=38355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:20.358340 21544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:20.358492 21544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:20.363235 21549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.363245 21550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.363273 21544 server_base.cc:1034] running on GCE node
W20260619 02:45:20.363266 21552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.363675 21544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:20.363945 21544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:20.365136 21544 hybrid_clock.cc:648] HybridClock initialized: now 1781837120365118 us; error 30 us; skew 500 ppm
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:20.367574 21544 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:45:20.368041 21544 webserver.cc:460] Webserver started at http://127.12.145.126:38355/ using document root <none> and password file <none>
I20260619 02:45:20.368213 21544 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:20.368263 21544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:20.369546 21544 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:45:20.370174 21559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.370368 21544 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:20.370467 21544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "c9e2a3b92e564343ad12233c4e31f3f7"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "1939db3f2c8e4c6b1e9a3ba08fb28e6d"
server_key_iv: "bc3921e4e3f8a010ec105495ca7ec85b"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.370836 21544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:20.386677 21544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:20.388863 21544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:20.388965 21544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:20.392702 21544 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:32987
I20260619 02:45:20.392741 21611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:32987 every 8 connection(s)
I20260619 02:45:20.393091 21544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:45:20.394418 21612 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:45:20.395020 21612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Bootstrap starting.
I20260619 02:45:20.401443 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21544
I20260619 02:45:20.401741 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:42213
--local_ip_for_outbound_sockets=127.12.145.65
--tserver_master_addrs=127.12.145.126:32987
--webserver_port=41317
--webserver_interface=127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:45:20.403460 21612 log.cc:824] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:20.405561 21612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:45:20.405879 21612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Bootstrap complete.
I20260619 02:45:20.409812 21612 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:20.410210 21612 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9e2a3b92e564343ad12233c4e31f3f7, State: Initialized, Role: FOLLOWER
I20260619 02:45:20.410391 21612 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:20.410473 21612 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:45:20.410529 21612 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:45:20.410609 21612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 1 FOLLOWER]: Advancing to term 2
I20260619 02:45:20.412204 21612 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:20.412323 21612 leader_election.cc:302] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9e2a3b92e564343ad12233c4e31f3f7; no voters:
I20260619 02:45:20.412494 21612 leader_election.cc:288] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 02:45:20.412555 21616 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 02:45:20.412704 21616 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9e2a3b92e564343ad12233c4e31f3f7, State: Running, Role: LEADER
I20260619 02:45:20.412760 21612 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:45:20.412789 21616 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } }
I20260619 02:45:20.413025 21616 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9e2a3b92e564343ad12233c4e31f3f7. Latest consensus state: current_term: 2 leader_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } } }
I20260619 02:45:20.413136 21616 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:20.413025 21617 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e2a3b92e564343ad12233c4e31f3f7" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 32987 } } }
I20260619 02:45:20.413242 21617 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7 [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:20.413460 21621 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:45:20.413975 21621 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:45:20.414160 21621 catalog_manager.cc:1259] Loaded cluster ID: 32c996c2700f40628897bc1306174a47
I20260619 02:45:20.414410 21621 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:45:20.415614 21621 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:45:20.415787 21621 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c9e2a3b92e564343ad12233c4e31f3f7: Loaded TSK: 0
I20260619 02:45:20.415994 21621 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 02:45:20.484838 21614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:20.485064 21614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:20.485113 21614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:20.486282 21614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:20.486347 21614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:20.486400 21614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:45:20.487897 21614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.65.keytab
--principal=oryx/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:42213
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=41317
--tserver_master_addrs=127.12.145.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:20.488169 21614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:20.488395 21614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:20.493173 21641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.493221 21638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.493376 21614 server_base.cc:1034] running on GCE node
W20260619 02:45:20.493424 21639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.493690 21614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:20.493956 21614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:20.495131 21614 hybrid_clock.cc:648] HybridClock initialized: now 1781837120495104 us; error 42 us; skew 500 ppm
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:20.497619 21614 init.cc:377] Logged in from keytab as oryx/127.12.145.65@KRBTEST.COM (short username oryx)
I20260619 02:45:20.498077 21614 webserver.cc:460] Webserver started at http://127.12.145.65:41317/ using document root <none> and password file <none>
I20260619 02:45:20.498311 21614 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:20.498365 21614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:20.499755 21614 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:45:20.500535 21648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.500751 21614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:45:20.500859 21614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "c79bd7d54a874823a071b76180c9c068"
format_stamp: "Formatted at 2026-06-19 02:45:19 on dist-test-slave-fbl4"
server_key: "ca891f9e008b77188f0e8bc612abe094"
server_key_iv: "8bd6af3f359282253cc35c943d6c3991"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.501214 21614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:20.517813 21614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:20.519918 21614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:20.520076 21614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:20.520329 21614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:20.520627 21614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:20.520678 21614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.520718 21614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:20.520743 21614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.526420 21614 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:42213
I20260619 02:45:20.526504 21761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:42213 every 8 connection(s)
I20260619 02:45:20.526819 21614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:45:20.527069 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21614
I20260619 02:45:20.527390 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:38197
--local_ip_for_outbound_sockets=127.12.145.66
--tserver_master_addrs=127.12.145.126:32987
--webserver_port=43819
--webserver_interface=127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:20.537748 21764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.527737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:47261)
0619 02:45:20.528123 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.528169 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.528844 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.529402 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.529406 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.530096 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.530350 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.530355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.532024 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.532025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.533258 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.533260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.534107 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.534108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.534238 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.534818 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.534829 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.537564 (+ 2735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":87,"threads_started":1}
W20260619 02:45:20.538017 21762 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:32987 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.145.126:32987: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
W20260619 02:45:20.538110 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.527825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:47261 (local address 127.12.145.126:32987)
0619 02:45:20.528037 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.528046 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.528282 (+ 236us) server_negotiation.cc:407] Connection header received
0619 02:45:20.529120 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.529129 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.529190 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.529340 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.530497 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.531892 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.533350 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.533922 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.534008 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.537702 (+ 3694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:47261: BlockingRecv error: recv got EOF from 127.12.145.65:47261 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":92,"threads_started":1}
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:20.542763 21764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.538223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:48663)
0619 02:45:20.538308 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.538317 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.538351 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.538635 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.538636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.538774 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.538821 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.538823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.539404 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.539405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.540211 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.540213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.540541 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.540541 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.540603 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.540982 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.540987 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.542723 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":72}
W20260619 02:45:20.543088 21767 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.538326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:48663 (local address 127.12.145.126:32987)
0619 02:45:20.538471 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.538473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.538483 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:45:20.538503 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.538503 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.538512 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.538618 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.538896 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.539334 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.540298 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.540474 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.540524 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.542816 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:48663: BlockingRecv error: recv got EOF from 127.12.145.65:48663 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:20.547115 21764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.542996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:37391)
0619 02:45:20.543047 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.543058 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.543101 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.543396 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.543397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.543520 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.543543 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.543544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.544135 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.544136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.544611 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.544613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.545013 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.545013 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.545070 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.545453 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.545457 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.547043 (+ 1586us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260619 02:45:20.547181 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.543083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:37391 (local address 127.12.145.126:32987)
0619 02:45:20.543117 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.543118 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.543286 (+ 168us) server_negotiation.cc:407] Connection header received
0619 02:45:20.543304 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.543304 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.543314 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.543393 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.543617 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.544058 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.544726 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.544912 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.544997 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.547108 (+ 2111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:37391: BlockingRecv error: recv got EOF from 127.12.145.65:37391 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260619 02:45:20.547366 21762 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 02:45:20.609385 21766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:20.609572 21766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:20.609594 21766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:20.610767 21766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:20.610806 21766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:20.610832 21766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:45:20.612309 21766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.66.keytab
--principal=oryx/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:38197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=43819
--tserver_master_addrs=127.12.145.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:20.612543 21766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:20.612820 21766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:20.617782 21772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.617828 21775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.617926 21773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.618062 21766 server_base.cc:1034] running on GCE node
I20260619 02:45:20.618245 21766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:20.618469 21766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:20.619622 21766 hybrid_clock.cc:648] HybridClock initialized: now 1781837120619617 us; error 47 us; skew 500 ppm
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:20.622031 21766 init.cc:377] Logged in from keytab as oryx/127.12.145.66@KRBTEST.COM (short username oryx)
I20260619 02:45:20.622483 21766 webserver.cc:460] Webserver started at http://127.12.145.66:43819/ using document root <none> and password file <none>
I20260619 02:45:20.622733 21766 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:20.622815 21766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:20.624078 21766 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:45:20.624643 21782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.624818 21766 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:20.624907 21766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "0cb8aa95417d4666af7ae677eb88baa4"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "3a708f8e1cec90012f0c61a516d11213"
server_key_iv: "a87da3299e8572b40e6fae9029bd01dd"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.625221 21766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:20.636147 21766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:20.637818 21766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:20.637964 21766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:20.638162 21766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:20.638446 21766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:20.638497 21766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.638535 21766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:20.638582 21766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.644402 21766 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:38197
I20260619 02:45:20.644443 21895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:38197 every 8 connection(s)
I20260619 02:45:20.644757 21766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 02:45:20.651486 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.645408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:60395 (local address 127.12.145.126:32987)
0619 02:45:20.645457 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.645460 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.645690 (+ 230us) server_negotiation.cc:407] Connection header received
0619 02:45:20.646162 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.646163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.646175 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.646236 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.647160 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.647646 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.648549 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.648723 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.648773 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.651440 (+ 2667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:60395: BlockingRecv error: recv got EOF from 127.12.145.66:60395 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:45:20.651619 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.645403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:60395)
0619 02:45:20.645544 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.645575 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.646080 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.646288 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.646291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.646901 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.647082 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.647086 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.647723 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.647723 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.648476 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.648477 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.648792 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.648792 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.648885 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.649330 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.649337 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.651355 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":83,"threads_started":1}
W20260619 02:45:20.651888 21896 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:32987 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.145.126:32987: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
I20260619 02:45:20.652441 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21766
I20260619 02:45:20.652755 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:38871
--local_ip_for_outbound_sockets=127.12.145.67
--tserver_master_addrs=127.12.145.126:32987
--webserver_port=41657
--webserver_interface=127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:20.656904 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.652127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:49843)
0619 02:45:20.652174 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.652186 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.652238 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.652380 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.652381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.652518 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.652573 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.652574 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.653257 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.653258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.654079 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.654093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.654488 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.654489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.654577 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.654998 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.655003 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.656811 (+ 1808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 02:45:20.656927 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.652181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:49843 (local address 127.12.145.126:32987)
0619 02:45:20.652230 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.652232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.652240 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:20.652323 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.652323 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.652331 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.652374 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.652641 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.653170 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.654201 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.654388 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.654476 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.656886 (+ 2410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:49843: BlockingRecv error: recv got EOF from 127.12.145.66:49843 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:20.661594 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.657243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:45539)
0619 02:45:20.657292 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.657304 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.657349 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.657459 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.657460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.657612 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.657646 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.657647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.658195 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.658196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.659096 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.659099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.659410 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.659411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.659470 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.659792 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.659797 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.661519 (+ 1722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:45:20.661644 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.657293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:45539 (local address 127.12.145.126:32987)
0619 02:45:20.657350 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.657352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.657359 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:45:20.657404 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.657405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.657411 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.657454 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.657713 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.658122 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.659173 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.659342 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.659391 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.661584 (+ 2193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:45539: BlockingRecv error: recv got EOF from 127.12.145.66:45539 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260619 02:45:20.661738 21896 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 02:45:20.733371 21899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:20.733590 21899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:20.733624 21899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:20.734823 21899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:20.734891 21899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:20.734933 21899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:45:20.736426 21899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/krb5kdc/oryx_127.12.145.67.keytab
--principal=oryx/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:38871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=41657
--tserver_master_addrs=127.12.145.126:32987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:20.736670 21899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:20.736878 21899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:20.741535 21907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.741513 21904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:20.741525 21905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:20.741650 21899 server_base.cc:1034] running on GCE node
I20260619 02:45:20.741849 21899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:20.742062 21899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:20.743214 21899 hybrid_clock.cc:648] HybridClock initialized: now 1781837120743207 us; error 35 us; skew 500 ppm
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837120, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:20.745457 21899 init.cc:377] Logged in from keytab as oryx/127.12.145.67@KRBTEST.COM (short username oryx)
I20260619 02:45:20.745882 21899 webserver.cc:460] Webserver started at http://127.12.145.67:41657/ using document root <none> and password file <none>
I20260619 02:45:20.746115 21899 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:20.746205 21899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:20.747625 21899 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:45:20.748203 21914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.748363 21899 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:20.748458 21899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "d75005e404f142c8b5ea304f2d7bf79e"
format_stamp: "Formatted at 2026-06-19 02:45:20 on dist-test-slave-fbl4"
server_key: "5ea32d4728828548b4e690d740e37d34"
server_key_iv: "08423593d854a4ae77bd63ef02345084"
server_key_version: "encryptionkey@0"
I20260619 02:45:20.748768 21899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:20.756738 21899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:20.758469 21899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:20.758679 21899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:20.758888 21899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:20.759177 21899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:20.759301 21899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.759383 21899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:20.759415 21899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:20.765053 21899 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:38871
I20260619 02:45:20.765121 22027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:38871 every 8 connection(s)
I20260619 02:45:20.765446 21899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:45:20.767798 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 21899
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 02:45:20.773176 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.766134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:39919 (local address 127.12.145.126:32987)
0619 02:45:20.766208 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.766210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.766362 (+ 152us) server_negotiation.cc:407] Connection header received
0619 02:45:20.766872 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.766873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.766882 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.766932 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.767808 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.768442 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.769611 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.769806 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.769871 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.773097 (+ 3226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:39919: BlockingRecv error: recv got EOF from 127.12.145.67:39919 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 02:45:20.773208 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.766096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:39919)
0619 02:45:20.766249 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.766281 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.766789 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.766982 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.766985 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.767539 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.767722 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.767727 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.768546 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.768547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.769531 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.769534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.769895 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.769896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.769988 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.770465 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.770472 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.773006 (+ 2534us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":97,"threads_started":1}
W20260619 02:45:20.773444 22028 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:32987 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.145.126:32987: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
I20260619 02:45:20.775434 21767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.768272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57128 (local address 127.12.145.126:32987)
0619 02:45:20.768312 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.768314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.768378 (+ 64us) server_negotiation.cc:407] Connection header received
0619 02:45:20.768453 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.768454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.768463 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.768541 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.769128 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.769765 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.770673 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.770940 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.771013 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.772242 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:20.772247 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:20.772247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:20.772258 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:20.773985 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:20.774386 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:20.774389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:20.774389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:20.774500 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:20.774730 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:20.774731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:20.774731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:20.774996 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:20.775102 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:20.775228 (+ 126us) server_negotiation.cc:299] Negotiation successful
0619 02:45:20.775303 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:20.778319 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.773624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:39069)
0619 02:45:20.773753 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.773763 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.773823 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.773946 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.773947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.774074 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.774146 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.774147 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.774985 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.774985 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.775865 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.775867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.776360 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.776361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.776409 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.776803 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.776808 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.778280 (+ 1472us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
W20260619 02:45:20.778400 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.773695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:39069 (local address 127.12.145.126:32987)
0619 02:45:20.773751 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.773753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.773793 (+ 40us) server_negotiation.cc:407] Connection header received
0619 02:45:20.773886 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.773887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.773895 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.773943 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.774253 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.774919 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.775994 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.776297 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.776353 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.778347 (+ 1994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:39069: BlockingRecv error: recv got EOF from 127.12.145.67:39069 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:20 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:20.782089 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:20.778598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:43021)
0619 02:45:20.778634 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:20.778643 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:20.778698 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:20.778795 (+ 97us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:20.778795 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:20.778891 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:20.778913 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.778914 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.779428 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.779428 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.779876 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:20.779878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.780151 (+ 273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.780152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:20.780183 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.780575 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:20.780584 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:20.782019 (+ 1435us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260619 02:45:20.782133 21765 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:20.778623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:43021 (local address 127.12.145.126:32987)
0619 02:45:20.778702 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:20.778704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:20.778712 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:20.778729 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:20.778729 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:20.778736 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:20.778783 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:20.778967 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.779370 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.779938 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:20.780096 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:20.780141 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:20.782079 (+ 1938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:43021: BlockingRecv error: recv got EOF from 127.12.145.67:43021 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260619 02:45:20.782227 22028 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Jun 19 02:45:21 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:21 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:21.552311 22033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:21.547742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:33585)
0619 02:45:21.547889 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:21.547902 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:21.547963 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:21.548091 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:21.548091 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:21.548237 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:21.548283 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:21.548284 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.548863 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.548864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:21.549403 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:21.549404 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.549810 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.549811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:21.549881 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:21.550367 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:21.550372 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:21.552246 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
W20260619 02:45:21.552445 22034 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:21.547812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:33585 (local address 127.12.145.126:32987)
0619 02:45:21.547950 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:21.547952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:21.547960 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:21.548014 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:21.548014 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:21.548023 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:21.548071 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:21.548342 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.548805 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.549468 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.549734 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.549811 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:21.552335 (+ 2524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:33585: BlockingRecv error: recv got EOF from 127.12.145.65:33585 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
Jun 19 02:45:21 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:21 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:21.666787 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:21.662139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:45315)
0619 02:45:21.662303 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:21.662316 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:21.662383 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:21.662539 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:21.662563 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:21.662749 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:21.662795 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:21.662797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.663458 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.663459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:21.664012 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:21.664014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.664380 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.664381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:21.664439 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:21.664928 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:21.664933 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:21.666679 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":90,"threads_started":1}
W20260619 02:45:21.666817 22034 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:21.662237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:45315 (local address 127.12.145.126:32987)
0619 02:45:21.662307 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:21.662310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:21.662364 (+ 54us) server_negotiation.cc:407] Connection header received
0619 02:45:21.662456 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:21.662457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:21.662470 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:21.662525 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:21.662876 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.663372 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.664097 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.664296 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.664379 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:21.666753 (+ 2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:45315: BlockingRecv error: recv got EOF from 127.12.145.66:45315 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Jun 19 02:45:21 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:21 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:21.787158 22036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:21.782613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:58349)
0619 02:45:21.782738 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:21.782749 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:21.782849 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:21.783079 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:21.783080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:21.783261 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:21.783314 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:21.783316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.783901 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.783902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:21.784412 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:21.784413 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.784702 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.784703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:21.784740 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:21.785214 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:21.785219 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:21.787086 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":54,"threads_started":1}
W20260619 02:45:21.787256 22034 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:21.782919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:58349 (local address 127.12.145.126:32987)
0619 02:45:21.782974 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:21.782976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:21.782983 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:45:21.783003 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:21.783004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:21.783015 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:21.783061 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:21.783374 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.783840 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.784475 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:21.784644 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:21.784692 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:21.787165 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:58349: BlockingRecv error: recv got EOF from 127.12.145.67:58349 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Jun 19 02:45:22 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:22 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:22.557437 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:22.552745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:36921)
0619 02:45:22.552887 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:22.552898 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:22.552953 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:22.553073 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:22.553074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:22.553261 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:22.553312 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:22.553314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.554042 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.554043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:22.554662 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:22.554664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.555028 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.555029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:22.555086 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:22.555568 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:22.555573 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:22.557342 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
W20260619 02:45:22.557497 22038 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:22.552827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:36921 (local address 127.12.145.126:32987)
0619 02:45:22.552958 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:22.552960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:22.552969 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:22.552994 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:22.552994 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:22.553003 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:22.553058 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:22.553375 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.553867 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.554769 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.554956 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.555031 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:22.557426 (+ 2395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:36921: BlockingRecv error: recv got EOF from 127.12.145.65:36921 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
Jun 19 02:45:22 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:22 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:22.671908 22039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:22.667326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:50189)
0619 02:45:22.667435 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:22.667453 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:22.667501 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:22.667624 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:22.667625 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:22.667793 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:22.667841 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:22.667842 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.668690 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.668691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:22.669209 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:22.669211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.669588 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.669589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:22.669624 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:22.670064 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:22.670068 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:22.671839 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":62,"threads_started":1}
W20260619 02:45:22.672049 22038 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:22.667410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:50189 (local address 127.12.145.126:32987)
0619 02:45:22.667503 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:22.667505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:22.667516 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:45:22.667542 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:22.667543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:22.667553 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:22.667611 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:22.667903 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.668604 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.669304 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.669498 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.669591 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:22.671950 (+ 2359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:50189: BlockingRecv error: recv got EOF from 127.12.145.66:50189 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Jun 19 02:45:22 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:22 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:22.791823 22040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:22.787553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:40883)
0619 02:45:22.787678 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:22.787691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:22.787758 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:22.787877 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:22.787878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:22.788029 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:22.788077 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:22.788078 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.788708 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.788708 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:22.789241 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:22.789242 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.789541 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.789542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:22.789579 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:22.790044 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:22.790049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:22.791753 (+ 1704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":67,"threads_started":1}
W20260619 02:45:22.791934 22038 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:22.787649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:40883 (local address 127.12.145.126:32987)
0619 02:45:22.787697 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:22.787699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:22.787735 (+ 36us) server_negotiation.cc:407] Connection header received
0619 02:45:22.787800 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:22.787801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:22.787812 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:22.787857 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:22.788139 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.788642 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.789312 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:22.789483 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:22.789531 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:22.791859 (+ 2328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:40883: BlockingRecv error: recv got EOF from 127.12.145.67:40883 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Jun 19 02:45:23 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:23 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:23.562265 22041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:23.557854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:40717)
0619 02:45:23.558004 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:23.558014 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:23.558068 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:23.558208 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:23.558209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:23.558366 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:23.558416 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:23.558418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.559101 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.559102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:23.559647 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:23.559648 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.559970 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.559971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:23.560013 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:23.560481 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:23.560485 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:23.562210 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
W20260619 02:45:23.562372 22042 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:23.557940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:40717 (local address 127.12.145.126:32987)
0619 02:45:23.558035 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:23.558038 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:23.558054 (+ 16us) server_negotiation.cc:407] Connection header received
0619 02:45:23.558122 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:23.558123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:23.558132 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:23.558187 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:23.558475 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.559023 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.559721 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.559904 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.559956 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:23.562296 (+ 2340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:40717: BlockingRecv error: recv got EOF from 127.12.145.65:40717 (error 108)
Metrics: {"server-negotiator.queue_time_us":74,"thread_start_us":49,"threads_started":1}
Jun 19 02:45:23 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:23 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:23.677057 22043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:23.672416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:58509)
0619 02:45:23.672590 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:23.672606 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:23.672673 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:23.672796 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:23.672797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:23.672973 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:23.673022 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:23.673023 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.673741 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.673743 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:23.674280 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:23.674282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.674626 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.674626 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:23.674676 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:23.675237 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:23.675241 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:23.677001 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
W20260619 02:45:23.677223 22042 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:23.672539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:58509 (local address 127.12.145.126:32987)
0619 02:45:23.672605 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:23.672606 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:23.672669 (+ 63us) server_negotiation.cc:407] Connection header received
0619 02:45:23.672719 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:23.672720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:23.672731 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:23.672778 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:23.673124 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.673653 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.674355 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.674540 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.674631 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:23.677155 (+ 2524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:58509: BlockingRecv error: recv got EOF from 127.12.145.66:58509 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Jun 19 02:45:23 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:23 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:23.796949 22044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:23.792393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:58107)
0619 02:45:23.792519 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:23.792529 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:23.792593 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:23.792705 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:23.792706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:23.792855 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:23.792901 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:23.792902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.793524 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.793525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:23.794326 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:23.794330 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.794744 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.794745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:23.794803 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:23.795220 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:23.795224 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:23.796892 (+ 1668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
W20260619 02:45:23.797072 22042 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:23.792453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:58107 (local address 127.12.145.126:32987)
0619 02:45:23.792526 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:23.792528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:23.792601 (+ 73us) server_negotiation.cc:407] Connection header received
0619 02:45:23.792637 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:23.792637 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:23.792648 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:23.792693 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:23.792955 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.793457 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.794397 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:23.794656 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:23.794733 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:23.796975 (+ 2242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:58107: BlockingRecv error: recv got EOF from 127.12.145.67:58107 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 19 02:45:24 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:24 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:24.567389 22045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:24.562785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:58849)
0619 02:45:24.562915 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:24.562928 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:24.562979 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:24.563118 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:24.563118 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:24.563282 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:24.563331 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:24.563332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.564253 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.564253 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:24.564769 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:24.564770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.565075 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.565076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:24.565113 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:24.565528 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:24.565532 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:24.567291 (+ 1759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
W20260619 02:45:24.567437 22046 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:24.562823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:58849 (local address 127.12.145.126:32987)
0619 02:45:24.562954 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:24.562956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:24.562968 (+ 12us) server_negotiation.cc:407] Connection header received
0619 02:45:24.563034 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:24.563034 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:24.563044 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:24.563104 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:24.563390 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.564199 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.564837 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.565015 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.565063 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:24.567368 (+ 2305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:58849: BlockingRecv error: recv got EOF from 127.12.145.65:58849 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
Jun 19 02:45:24 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:24 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:24.682049 22047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:24.677481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:41711)
0619 02:45:24.677647 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:24.677661 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:24.677749 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:24.677918 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:24.677919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:24.678089 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:24.678134 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:24.678136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.678891 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.678892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:24.679431 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:24.679433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.679821 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.679822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:24.679895 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:24.680364 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:24.680368 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:24.681981 (+ 1613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
W20260619 02:45:24.682174 22046 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:24.677554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:41711 (local address 127.12.145.126:32987)
0619 02:45:24.677631 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:24.677633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:24.677726 (+ 93us) server_negotiation.cc:407] Connection header received
0619 02:45:24.677823 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:24.677824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:24.677836 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:24.677900 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:24.678212 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.678801 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.679518 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.679717 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.679807 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:24.682097 (+ 2290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:41711: BlockingRecv error: recv got EOF from 127.12.145.66:41711 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Jun 19 02:45:24 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:24 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:24.801899 22048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:24.797381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:35451)
0619 02:45:24.797550 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:24.797563 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:24.797626 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:24.797749 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:24.797750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:24.797898 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:24.797946 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:24.797947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.798625 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.798626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:24.799153 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:24.799155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.799491 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.799492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:24.799528 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:24.799934 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:24.799938 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:24.801842 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":78,"threads_started":1}
W20260619 02:45:24.801988 22046 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:24.797580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:35451 (local address 127.12.145.126:32987)
0619 02:45:24.797647 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:24.797648 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:24.797656 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:24.797674 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:24.797675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:24.797686 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:24.797735 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:24.798021 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.798515 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.799246 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:24.799419 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:24.799481 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:24.801924 (+ 2443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:35451: BlockingRecv error: recv got EOF from 127.12.145.67:35451 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Jun 19 02:45:25 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:25 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:25.572299 22049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:25.567833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:58091)
0619 02:45:25.567967 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:25.567977 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:25.568022 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:25.568134 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:25.568135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:25.568289 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:25.568338 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:25.568339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.568945 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.568945 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:25.569438 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:25.569439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.569738 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.569738 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:25.569779 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:25.570277 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:25.570281 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:25.572199 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
W20260619 02:45:25.572365 22050 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:25.567904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:58091 (local address 127.12.145.126:32987)
0619 02:45:25.568020 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:25.568022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:25.568038 (+ 16us) server_negotiation.cc:407] Connection header received
0619 02:45:25.568059 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:25.568059 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:25.568069 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:25.568131 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:25.568393 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.568880 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.569500 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.569675 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.569721 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:25.572279 (+ 2558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:58091: BlockingRecv error: recv got EOF from 127.12.145.65:58091 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":66,"threads_started":1}
Jun 19 02:45:25 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:25 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:25.686941 22051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:25.682492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:53393)
0619 02:45:25.682620 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:25.682632 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:25.682688 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:25.682887 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:25.682888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:25.683045 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:25.683092 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:25.683094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.683726 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.683727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:25.684229 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:25.684231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.684545 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.684546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:25.684588 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:25.685077 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:25.685081 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:25.686885 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":98,"threads_started":1}
W20260619 02:45:25.687177 22050 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:25.682684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:53393 (local address 127.12.145.126:32987)
0619 02:45:25.682751 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:25.682753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:25.682767 (+ 14us) server_negotiation.cc:407] Connection header received
0619 02:45:25.682798 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:25.682798 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:25.682808 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:25.682868 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:25.683167 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.683655 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.684299 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.684480 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.684530 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:25.687096 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:53393: BlockingRecv error: recv got EOF from 127.12.145.66:53393 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Jun 19 02:45:25 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:25 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:25.807343 22052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:25.802441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:40717)
0619 02:45:25.802606 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:25.802619 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:25.802688 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:25.802878 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:25.802879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:25.803075 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:25.803122 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:25.803124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.803846 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.803847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:25.804462 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:25.804464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.804848 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.804849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:25.804918 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:25.805352 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:25.805356 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:25.807239 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":79,"threads_started":1}
W20260619 02:45:25.807399 22050 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:25.802537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:40717 (local address 127.12.145.126:32987)
0619 02:45:25.802609 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:25.802611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:25.802669 (+ 58us) server_negotiation.cc:407] Connection header received
0619 02:45:25.802760 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:25.802761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:25.802777 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:25.802860 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:25.803200 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.803760 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.804571 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:25.804749 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:25.804849 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:25.807336 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:40717: BlockingRecv error: recv got EOF from 127.12.145.67:40717 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 19 02:45:26 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:26 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:26.580332 22053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:26.572786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:50057)
0619 02:45:26.572942 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:26.572952 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:26.573031 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:26.573162 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:26.573163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:26.573326 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:26.573373 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:26.573374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.574004 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.574005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:26.574598 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:26.574599 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.574942 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.574943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:26.574981 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:26.578341 (+ 3360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:26.578345 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:26.580274 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":109,"threads_started":1}
W20260619 02:45:26.580504 22054 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:26.572891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:50057 (local address 127.12.145.126:32987)
0619 02:45:26.573004 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:26.573006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:26.573017 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:45:26.573077 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:26.573078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:26.573088 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:26.573144 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:26.573435 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.573932 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.574672 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.574872 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.574935 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:26.580407 (+ 5472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:50057: BlockingRecv error: recv got EOF from 127.12.145.65:50057 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":46,"threads_started":1}
Jun 19 02:45:26 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:26 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:26.691833 22055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:26.687381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:41545)
0619 02:45:26.687517 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:26.687527 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:26.687580 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:26.687703 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:26.687704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:26.687863 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:26.687913 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:26.687915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.688518 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.688519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:26.689041 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:26.689042 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.689427 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.689428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:26.689475 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:26.689910 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:26.689914 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:26.691774 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
W20260619 02:45:26.691979 22054 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:26.687465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:41545 (local address 127.12.145.126:32987)
0619 02:45:26.687539 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:26.687541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:26.687567 (+ 26us) server_negotiation.cc:407] Connection header received
0619 02:45:26.687634 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:26.687635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:26.687645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:26.687690 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:26.687974 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.688455 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.689149 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.689359 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.689410 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:26.691895 (+ 2485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:41545: BlockingRecv error: recv got EOF from 127.12.145.66:41545 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Jun 19 02:45:26 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:26 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:26.812201 22056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:26.807942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:50151)
0619 02:45:26.808110 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:26.808120 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:26.808183 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:26.808299 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:26.808299 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:26.808459 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:26.808506 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:26.808508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.809100 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.809100 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:26.809595 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:26.809596 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.809899 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.809900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:26.809936 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:26.810435 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:26.810457 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:26.812142 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
W20260619 02:45:26.812294 22054 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:26.808000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:50151 (local address 127.12.145.126:32987)
0619 02:45:26.808068 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:26.808070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:26.808190 (+ 120us) server_negotiation.cc:407] Connection header received
0619 02:45:26.808228 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:26.808229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:26.808240 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:26.808279 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:26.808566 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.809038 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.809662 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:26.809842 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:26.809887 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:26.812229 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:50151: BlockingRecv error: recv got EOF from 127.12.145.67:50151 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Jun 19 02:45:27 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:27 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:27.584998 22057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:27.580764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:38049)
0619 02:45:27.580898 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:27.580908 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:27.580955 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:27.581098 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:27.581099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:27.581265 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:27.581316 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:27.581317 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.581911 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.581912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:27.582424 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:27.582425 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.582722 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.582723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:27.582759 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:27.583246 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:27.583251 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:27.584927 (+ 1676us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
W20260619 02:45:27.585146 22058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:27.580856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:38049 (local address 127.12.145.126:32987)
0619 02:45:27.580970 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:27.580972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:27.580981 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:27.581003 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:27.581004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:27.581021 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:27.581081 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:27.581373 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.581854 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.582484 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.582670 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.582714 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:27.585026 (+ 2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:38049: BlockingRecv error: recv got EOF from 127.12.145.65:38049 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":65,"threads_started":1}
Jun 19 02:45:27 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:27 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:27.697062 22059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:27.692271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:46793)
0619 02:45:27.692442 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:27.692453 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:27.692539 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:27.692710 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:27.692711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:27.692939 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:27.692997 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:27.692999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.693628 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.693629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:27.694189 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:27.694191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.694583 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.694584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:27.694640 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:27.695146 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:27.695152 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:27.697002 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":82,"threads_started":1}
W20260619 02:45:27.697165 22058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:27.692350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:46793 (local address 127.12.145.126:32987)
0619 02:45:27.692425 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:27.692427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:27.692519 (+ 92us) server_negotiation.cc:407] Connection header received
0619 02:45:27.692606 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:27.692607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:27.692617 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:27.692700 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:27.693076 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.693550 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.694278 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.694470 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.694591 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:27.697090 (+ 2499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:46793: BlockingRecv error: recv got EOF from 127.12.145.66:46793 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Jun 19 02:45:27 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:27 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:27.817277 22060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:27.812724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:46839)
0619 02:45:27.812833 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:27.812844 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:27.812907 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:27.813023 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:27.813024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:27.813216 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:27.813264 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:27.813266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.814077 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.814079 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:27.814761 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:27.814764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.815083 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.815083 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:27.815137 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:27.815564 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:27.815568 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:27.817219 (+ 1651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":63,"threads_started":1}
W20260619 02:45:27.817368 22058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:27.812785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:46839 (local address 127.12.145.126:32987)
0619 02:45:27.812845 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:27.812847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:27.812907 (+ 60us) server_negotiation.cc:407] Connection header received
0619 02:45:27.812948 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:27.812948 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:27.812960 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:27.813044 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:27.813358 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.813950 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.814837 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:27.815018 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:27.815075 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:27.817303 (+ 2228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:46839: BlockingRecv error: recv got EOF from 127.12.145.67:46839 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Jun 19 02:45:28 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:28 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:28.589982 22061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:28.585465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:55287)
0619 02:45:28.585600 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:28.585611 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:28.585662 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:28.585850 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:28.585850 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:28.586007 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:28.586057 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:28.586059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.586711 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.586712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:28.587226 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:28.587227 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.587551 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.587552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:28.587588 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:28.588063 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:28.588068 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:28.589876 (+ 1808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
W20260619 02:45:28.590027 22062 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:28.585613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:55287 (local address 127.12.145.126:32987)
0619 02:45:28.585737 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:28.585738 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:28.585745 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:45:28.585765 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:28.585766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:28.585774 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:28.585836 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:28.586120 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.586646 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.587300 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.587489 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.587541 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:28.589961 (+ 2420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:55287: BlockingRecv error: recv got EOF from 127.12.145.65:55287 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":74,"threads_started":1}
Jun 19 02:45:28 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:28 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:28.702364 22063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:28.697551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:57911)
0619 02:45:28.697774 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:28.697784 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:28.697859 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:28.698011 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:28.698011 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:28.698201 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:28.698249 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:28.698250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.699099 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.699100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:28.699651 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:28.699653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.700008 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.700009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:28.700072 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:28.700571 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:28.700575 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:28.702260 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":105,"threads_started":1}
W20260619 02:45:28.702405 22062 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:28.697635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:57911 (local address 127.12.145.126:32987)
0619 02:45:28.697711 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:28.697713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:28.697843 (+ 130us) server_negotiation.cc:407] Connection header received
0619 02:45:28.697942 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:28.697943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:28.697954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:28.697996 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:28.698327 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.699021 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.699737 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.699935 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.700010 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:28.702342 (+ 2332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:57911: BlockingRecv error: recv got EOF from 127.12.145.66:57911 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 19 02:45:28 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:28 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:28.821898 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:28.817782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:40631)
0619 02:45:28.817912 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:28.817922 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:28.817978 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:28.818081 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:28.818081 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:28.818241 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:28.818290 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:28.818291 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.818960 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.818961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:28.819469 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:28.819471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.819773 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.819774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:28.819811 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:28.820229 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:28.820233 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:28.821844 (+ 1611us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":67,"threads_started":1}
W20260619 02:45:28.821993 22062 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:28.817856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:40631 (local address 127.12.145.126:32987)
0619 02:45:28.817934 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:28.817936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:28.817963 (+ 27us) server_negotiation.cc:407] Connection header received
0619 02:45:28.818018 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:28.818018 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:28.818030 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:28.818075 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:28.818344 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.818899 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.819535 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:28.819716 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:28.819765 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:28.821926 (+ 2161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:40631: BlockingRecv error: recv got EOF from 127.12.145.67:40631 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 19 02:45:29 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:29 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:29.594803 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:29.590455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:48743)
0619 02:45:29.590606 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:29.590622 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:29.590674 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:29.590834 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:29.590835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:29.591001 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:29.591047 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:29.591049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.591668 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.591668 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:29.592187 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:29.592188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.592495 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.592495 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:29.592531 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:29.592932 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:29.592936 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:29.594735 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":75,"threads_started":1}
W20260619 02:45:29.594880 22066 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:29.590531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:48743 (local address 127.12.145.126:32987)
0619 02:45:29.590654 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:29.590656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:29.590669 (+ 13us) server_negotiation.cc:407] Connection header received
0619 02:45:29.590753 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:29.590754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:29.590765 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:29.590817 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:29.591113 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.591603 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.592257 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.592432 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.592481 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:29.594825 (+ 2344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:48743: BlockingRecv error: recv got EOF from 127.12.145.65:48743 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
Jun 19 02:45:29 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:29 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:29.707772 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:29.702901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:49791)
0619 02:45:29.703032 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:29.703045 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:29.703115 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:29.703293 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:29.703294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:29.703465 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:29.703511 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:29.703513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.704240 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.704241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:29.704843 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:29.704844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.705206 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.705207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:29.705245 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:29.705831 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:29.705836 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:29.707715 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
W20260619 02:45:29.707962 22066 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:29.703019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:49791 (local address 127.12.145.126:32987)
0619 02:45:29.703068 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:29.703070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:29.703095 (+ 25us) server_negotiation.cc:407] Connection header received
0619 02:45:29.703185 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:29.703186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:29.703200 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:29.703273 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:29.703651 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.704164 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.704911 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.705133 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.705199 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:29.707877 (+ 2678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:49791: BlockingRecv error: recv got EOF from 127.12.145.66:49791 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Jun 19 02:45:29 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:29 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:29.826922 22068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:29.822393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:57835)
0619 02:45:29.822594 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:29.822605 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:29.822696 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:29.822841 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:29.822842 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:29.823006 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:29.823050 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:29.823051 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.823643 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.823644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:29.824139 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:29.824141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.824446 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.824448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:29.824515 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:29.825019 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:29.825023 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:29.826855 (+ 1832us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":100,"threads_started":1}
W20260619 02:45:29.827019 22066 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:29.822480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:57835 (local address 127.12.145.126:32987)
0619 02:45:29.822563 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:29.822565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:29.822705 (+ 140us) server_negotiation.cc:407] Connection header received
0619 02:45:29.822754 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:29.822755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:29.822770 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:29.822833 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:29.823110 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.823579 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.824205 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:29.824369 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:29.824444 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:29.826934 (+ 2490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:57835: BlockingRecv error: recv got EOF from 127.12.145.67:57835 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Jun 19 02:45:30 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:30 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:30.600438 22069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:30.595335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:54755)
0619 02:45:30.595485 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:30.595495 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:30.595551 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:30.595759 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:30.595760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:30.595920 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:30.595980 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:30.595981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.596896 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.596897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:30.597459 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:30.597461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.597777 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.597778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:30.597817 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:30.598323 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:30.598329 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:30.600338 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
W20260619 02:45:30.600502 22070 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:30.595428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:54755 (local address 127.12.145.126:32987)
0619 02:45:30.595527 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:30.595528 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:30.595536 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:30.595630 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:30.595630 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:30.595639 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:30.595723 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:30.596059 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.596696 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.597525 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.597712 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.597764 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:30.600424 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:54755: BlockingRecv error: recv got EOF from 127.12.145.65:54755 (error 108)
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":47,"threads_started":1}
Jun 19 02:45:30 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:30 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:30.712612 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:30.708187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:55165)
0619 02:45:30.708311 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:30.708321 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:30.708374 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:30.708492 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:30.708493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:30.708684 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:30.708731 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:30.708733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.709342 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.709343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:30.709861 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:30.709862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.710158 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.710159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:30.710197 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:30.710713 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:30.710718 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:30.712530 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
W20260619 02:45:30.712688 22070 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:30.708253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:55165 (local address 127.12.145.126:32987)
0619 02:45:30.708307 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:30.708309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:30.708374 (+ 65us) server_negotiation.cc:407] Connection header received
0619 02:45:30.708413 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:30.708414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:30.708425 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:30.708474 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:30.708787 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.709278 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.709923 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.710094 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.710142 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:30.712638 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:55165: BlockingRecv error: recv got EOF from 127.12.145.66:55165 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Jun 19 02:45:30 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:30 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:30.832170 22072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:30.827451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:35933)
0619 02:45:30.827584 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:30.827593 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:30.827638 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:30.827772 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:30.827772 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:30.827921 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:30.827967 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:30.827969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.828736 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.828737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:30.829260 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:30.829261 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.829611 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.829611 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:30.829669 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:30.830145 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:30.830149 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:30.832065 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
W20260619 02:45:30.832206 22070 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:30.827559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:35933 (local address 127.12.145.126:32987)
0619 02:45:30.827625 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:30.827627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:30.827644 (+ 17us) server_negotiation.cc:407] Connection header received
0619 02:45:30.827690 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:30.827690 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:30.827701 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:30.827753 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:30.828090 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.828623 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.829348 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:30.829538 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:30.829613 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:30.832143 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:35933: BlockingRecv error: recv got EOF from 127.12.145.67:35933 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Jun 19 02:45:31 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:31 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:31.608748 22073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:31.600994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:36003)
0619 02:45:31.601130 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:31.601147 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:31.601206 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:31.601318 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:31.601318 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:31.601483 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:31.601529 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:31.601530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.602153 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.602153 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:31.602734 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:31.602736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.603040 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.603041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:31.603078 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:31.606912 (+ 3834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:31.606917 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:31.608641 (+ 1724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
W20260619 02:45:31.608796 22074 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:31.601022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:36003 (local address 127.12.145.126:32987)
0619 02:45:31.601141 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:31.601143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:31.601202 (+ 59us) server_negotiation.cc:407] Connection header received
0619 02:45:31.601247 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:31.601247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:31.601257 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:31.601307 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:31.601586 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.602086 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.602799 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.602980 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.603030 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:31.608723 (+ 5693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:36003: BlockingRecv error: recv got EOF from 127.12.145.65:36003 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":65,"threads_started":1}
Jun 19 02:45:31 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:31 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:31.718222 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:31.713123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:60569)
0619 02:45:31.713260 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:31.713272 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:31.713344 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:31.713542 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:31.713543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:31.713755 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:31.713809 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:31.713811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.714516 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.714517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:31.715423 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:31.715427 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.715778 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.715779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:31.715839 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:31.716236 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:31.716241 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:31.718112 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
W20260619 02:45:31.718254 22074 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:31.713189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:60569 (local address 127.12.145.126:32987)
0619 02:45:31.713259 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:31.713264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:31.713324 (+ 60us) server_negotiation.cc:407] Connection header received
0619 02:45:31.713418 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:31.713419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:31.713432 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:31.713529 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:31.713881 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.714440 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.715515 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.715704 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.715758 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:31.718179 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:60569: BlockingRecv error: recv got EOF from 127.12.145.66:60569 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Jun 19 02:45:31 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:31 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:31.837090 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:31.832661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:58709)
0619 02:45:31.832801 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:31.832818 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:31.832864 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:31.832979 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:31.832980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:31.833136 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:31.833191 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:31.833193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.833811 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.833811 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:31.834369 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:31.834371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.834706 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.834707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:31.834747 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:31.835181 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:31.835185 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:31.836992 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":95,"threads_started":1}
W20260619 02:45:31.837170 22074 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:31.832701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:58709 (local address 127.12.145.126:32987)
0619 02:45:31.832871 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:31.832872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:31.832881 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:31.832902 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:31.832903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:31.832913 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:31.832965 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:31.833266 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.833749 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.834442 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:31.834648 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:31.834699 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:31.837090 (+ 2391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:58709: BlockingRecv error: recv got EOF from 127.12.145.67:58709 (error 108)
Metrics: {"server-negotiator.queue_time_us":140}
Jun 19 02:45:32 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:32 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:32.613678 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:32.609197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:32843)
0619 02:45:32.609369 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:32.609380 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:32.609435 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:32.609569 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:32.609570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:32.609735 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:32.609782 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:32.609783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.610414 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.610415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:32.610952 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:32.610953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.611282 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.611283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:32.611320 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:32.611729 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:32.611733 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:32.613619 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
W20260619 02:45:32.613850 22078 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:32.609293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:32843 (local address 127.12.145.126:32987)
0619 02:45:32.609399 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:32.609401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:32.609423 (+ 22us) server_negotiation.cc:407] Connection header received
0619 02:45:32.609491 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:32.609491 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:32.609516 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:32.609565 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:32.609844 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.610347 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.611023 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.611215 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.611272 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:32.613755 (+ 2483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:32843: BlockingRecv error: recv got EOF from 127.12.145.65:32843 (error 108)
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":47,"threads_started":1}
Jun 19 02:45:32 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:32 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:32.723179 22079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:32.718791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:35925)
0619 02:45:32.718931 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:32.718941 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:32.718996 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:32.719139 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:32.719140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:32.719303 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:32.719348 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:32.719349 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.719971 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.719972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:32.720474 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:32.720476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.720786 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.720787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:32.720826 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:32.721342 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:32.721346 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:32.723101 (+ 1755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
W20260619 02:45:32.723234 22078 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:32.718862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:35925 (local address 127.12.145.126:32987)
0619 02:45:32.718909 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:32.718911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:32.718999 (+ 88us) server_negotiation.cc:407] Connection header received
0619 02:45:32.719041 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:32.719041 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:32.719051 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:32.719100 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:32.719411 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.719908 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.720544 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.720724 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.720772 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:32.723189 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:35925: BlockingRecv error: recv got EOF from 127.12.145.66:35925 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Jun 19 02:45:32 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:32 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:32.841792 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:32.837531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:34431)
0619 02:45:32.837683 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:32.837693 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:32.837752 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:32.837873 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:32.837874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:32.838044 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:32.838091 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:32.838093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.838728 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.838729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:32.839242 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:32.839243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.839535 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.839535 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:32.839572 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:32.840064 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:32.840069 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:32.841736 (+ 1667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":81,"threads_started":1}
W20260619 02:45:32.841892 22078 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:32.837583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:34431 (local address 127.12.145.126:32987)
0619 02:45:32.837657 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:32.837659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:32.837749 (+ 90us) server_negotiation.cc:407] Connection header received
0619 02:45:32.837793 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:32.837794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:32.837805 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:32.837854 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:32.838147 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.838667 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.839307 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:32.839477 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:32.839524 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:32.841821 (+ 2297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:34431: BlockingRecv error: recv got EOF from 127.12.145.67:34431 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Jun 19 02:45:33 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:33 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:33.618517 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:33.614089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:51757)
0619 02:45:33.614258 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:33.614269 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:33.614360 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:33.614504 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:33.614505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:33.614692 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:33.614741 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:33.614742 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.615352 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.615352 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:33.615857 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:33.615858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.616176 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.616177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:33.616234 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:33.616769 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:33.616774 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:33.618461 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":101,"threads_started":1}
W20260619 02:45:33.618729 22082 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:33.614184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:51757 (local address 127.12.145.126:32987)
0619 02:45:33.614299 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:33.614301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:33.614337 (+ 36us) server_negotiation.cc:407] Connection header received
0619 02:45:33.614419 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:33.614419 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:33.614429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:33.614488 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:33.614802 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.615288 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.615920 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.616112 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.616153 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:33.618595 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:51757: BlockingRecv error: recv got EOF from 127.12.145.65:51757 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":47,"threads_started":1}
Jun 19 02:45:33 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:33 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:33.728622 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:33.723823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:43223)
0619 02:45:33.724003 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:33.724015 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:33.724168 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:33.724353 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:33.724354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:33.724569 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:33.724615 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:33.724617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.725245 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.725246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:33.725795 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:33.725796 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.726167 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.726168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:33.726217 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:33.726694 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:33.726699 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:33.728515 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":90,"threads_started":1}
W20260619 02:45:33.728660 22082 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:33.723960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:43223 (local address 127.12.145.126:32987)
0619 02:45:33.724005 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:33.724009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:33.724131 (+ 122us) server_negotiation.cc:407] Connection header received
0619 02:45:33.724261 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:33.724262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:33.724275 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:33.724328 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:33.724683 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.725179 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.725880 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.726087 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.726135 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:33.728588 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:43223: BlockingRecv error: recv got EOF from 127.12.145.66:43223 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Jun 19 02:45:33 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:33 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:33.846402 22084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:33.842233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:51601)
0619 02:45:33.842361 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:33.842372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:33.842429 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:33.842578 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:33.842578 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:33.842746 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:33.842792 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:33.842794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.843392 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.843392 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:33.843958 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:33.843960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.844263 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.844263 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:33.844300 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:33.844731 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:33.844735 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:33.846338 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
W20260619 02:45:33.846511 22082 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:33.842294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:51601 (local address 127.12.145.126:32987)
0619 02:45:33.842468 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:33.842470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:33.842478 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:33.842497 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:33.842498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:33.842509 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:33.842572 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:33.842863 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.843331 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.844035 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:33.844205 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:33.844251 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:33.846420 (+ 2169us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:51601: BlockingRecv error: recv got EOF from 127.12.145.67:51601 (error 108)
Metrics: {"server-negotiator.queue_time_us":143}
Jun 19 02:45:34 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:34 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:34.623291 22085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:34.619021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:35509)
0619 02:45:34.619161 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:34.619171 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:34.619221 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:34.619338 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:34.619339 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:34.619504 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:34.619549 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:34.619551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.620164 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.620165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:34.620687 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:34.620688 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.620991 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.620992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:34.621028 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:34.621486 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:34.621491 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:34.623223 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":65,"threads_started":1}
W20260619 02:45:34.623382 22086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:34.619071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:35509 (local address 127.12.145.126:32987)
0619 02:45:34.619192 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:34.619194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:34.619209 (+ 15us) server_negotiation.cc:407] Connection header received
0619 02:45:34.619265 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:34.619266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:34.619275 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:34.619331 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:34.619609 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.620098 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.620753 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.620933 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.620981 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:34.623312 (+ 2331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:35509: BlockingRecv error: recv got EOF from 127.12.145.65:35509 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":80,"threads_started":1}
Jun 19 02:45:34 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:34 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:34.733426 22087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:34.729064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:58055)
0619 02:45:34.729187 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:34.729198 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:34.729260 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:34.729383 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:34.729383 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:34.729545 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:34.729589 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:34.729591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.730232 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.730232 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:34.730779 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:34.730780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.731110 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.731111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:34.731151 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:34.731635 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:34.731640 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:34.733370 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":86,"threads_started":1}
W20260619 02:45:34.733548 22086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:34.729131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:58055 (local address 127.12.145.126:32987)
0619 02:45:34.729181 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:34.729183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:34.729249 (+ 66us) server_negotiation.cc:407] Connection header received
0619 02:45:34.729305 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:34.729305 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:34.729315 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:34.729366 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:34.729674 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.730164 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.730868 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.731046 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.731119 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:34.733452 (+ 2333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:58055: BlockingRecv error: recv got EOF from 127.12.145.66:58055 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Jun 19 02:45:34 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:34 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.67@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:34.851276 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:34.846824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.67:37811)
0619 02:45:34.847005 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:34.847015 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:34.847075 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:34.847201 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:34.847201 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:34.847358 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:34.847405 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:34.847407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.848003 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.848003 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:34.848503 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:34.848504 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.848833 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.848834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:34.848872 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:34.849356 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:34.849361 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:34.851173 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":75,"threads_started":1}
W20260619 02:45:34.851364 22086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:34.846875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:37811 (local address 127.12.145.126:32987)
0619 02:45:34.846918 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:34.846920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:34.847071 (+ 151us) server_negotiation.cc:407] Connection header received
0619 02:45:34.847124 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:34.847124 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:34.847137 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:34.847184 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:34.847461 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.847942 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.848565 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:34.848774 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:34.848822 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:34.851277 (+ 2455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.67:37811: BlockingRecv error: recv got EOF from 127.12.145.67:37811 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Jun 19 02:45:35 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:35 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.65@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:35.628439 22089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:35.623878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.65:55407)
0619 02:45:35.624014 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:35.624027 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:35.624082 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:35.624378 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:35.624379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:35.624602 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:35.624669 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:35.624670 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.625305 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.625306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:35.625823 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:35.625825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.626139 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.626140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:35.626179 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:35.626617 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:35.626622 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:35.628348 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
W20260619 02:45:35.628509 22090 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:35.623936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:55407 (local address 127.12.145.126:32987)
0619 02:45:35.624062 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:35.624065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:35.624073 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:45:35.624167 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:35.624168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:35.624181 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:35.624252 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:35.624742 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.625235 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.625893 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.626073 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.626123 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:35.628419 (+ 2296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.65:55407: BlockingRecv error: recv got EOF from 127.12.145.65:55407 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
Jun 19 02:45:35 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 02:45:35 dist-test-slave-fbl4 krb5kdc[21031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.145.66@KRBTEST.COM for oryx/127.12.145.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 02:45:35.738237 22091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:35.733842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:32987 (local address 127.12.145.66:41259)
0619 02:45:35.733938 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:35.733951 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:35.734020 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:35.734130 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:35.734131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:35.734274 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:35.734320 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:35.734321 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.735089 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.735089 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:35.735590 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:35.735591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.735974 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.735975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:35.736025 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:35.736426 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:35.736430 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:35.738130 (+ 1700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.145.126:32987: Server oryx/127.12.145.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":48,"threads_started":1}
W20260619 02:45:35.738268 22090 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:35.733906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:41259 (local address 127.12.145.126:32987)
0619 02:45:35.733968 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:35.733970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:35.734005 (+ 35us) server_negotiation.cc:407] Connection header received
0619 02:45:35.734071 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:35.734072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:35.734081 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:35.734126 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:35.734371 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.735011 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.735656 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.735826 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.735876 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:35.738205 (+ 2329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.145.66:41259: BlockingRecv error: recv got EOF from 127.12.145.66:41259 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260619 02:45:35.773376 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21614
I20260619 02:45:35.777575 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21766
I20260619 02:45:35.781410 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21899
I20260619 02:45:35.785247 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 21544
2026-06-19T02:45:35Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17328 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-06-19T02:45:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:45:35Z Disabled control of system clock
I20260619 02:45:35.811842 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:38689
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:38689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260619 02:45:35.892004 22095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:35.892190 22095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:35.892210 22095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:35.893365 22095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:45:35.893404 22095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:35.893416 22095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:35.893428 22095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:45:35.893476 22095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:45:35.894810 22095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:38689
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:38689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:35.895049 22095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:35.895337 22095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 02:45:35.900328 22095 server_base.cc:1034] running on GCE node
W20260619 02:45:35.900293 22100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:35.900281 22103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:35.900300 22101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:35.900781 22095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:35.901072 22095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:35.902236 22095 hybrid_clock.cc:648] HybridClock initialized: now 1781837135902232 us; error 38 us; skew 500 ppm
I20260619 02:45:35.903579 22095 webserver.cc:460] Webserver started at http://127.12.145.126:35845/ using document root <none> and password file <none>
I20260619 02:45:35.903843 22095 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:35.903914 22095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:35.904057 22095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:35.905057 22095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1"
format_stamp: "Formatted at 2026-06-19 02:45:35 on dist-test-slave-fbl4"
server_key: "dedcdc5aed4ed46e18422701f897c6e9"
server_key_iv: "eab98320b5721596026a5664e585e0a3"
server_key_version: "encryptionkey@0"
I20260619 02:45:35.905412 22095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1"
format_stamp: "Formatted at 2026-06-19 02:45:35 on dist-test-slave-fbl4"
server_key: "dedcdc5aed4ed46e18422701f897c6e9"
server_key_iv: "eab98320b5721596026a5664e585e0a3"
server_key_version: "encryptionkey@0"
I20260619 02:45:35.906682 22095 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:45:35.907400 22109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:35.907562 22095 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:35.907670 22095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1"
format_stamp: "Formatted at 2026-06-19 02:45:35 on dist-test-slave-fbl4"
server_key: "dedcdc5aed4ed46e18422701f897c6e9"
server_key_iv: "eab98320b5721596026a5664e585e0a3"
server_key_version: "encryptionkey@0"
I20260619 02:45:35.907752 22095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:35.925513 22095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:35.925833 22095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:35.925985 22095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:35.929844 22095 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:38689
I20260619 02:45:35.929880 22161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:38689 every 8 connection(s)
I20260619 02:45:35.930202 22095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:45:35.930902 22162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:35.933311 22162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1: Bootstrap starting.
I20260619 02:45:35.933823 22162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:35.934072 22162 log.cc:824] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:35.934693 22162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1: No bootstrap required, opened a new log
I20260619 02:45:35.935827 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22095
I20260619 02:45:35.935917 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:45:35.936115 12869 external_mini_cluster.cc:1428] Setting key f4f6f670c764fe4432680d2bd2bdecc3
I20260619 02:45:35.936609 22162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 38689 } }
I20260619 02:45:35.936787 22162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:35.936825 22162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e359c2a27f1486e9b8bcf8ce570b7f1, State: Initialized, Role: FOLLOWER
I20260619 02:45:35.936969 22162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 38689 } }
I20260619 02:45:35.937047 22162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:45:35.937067 22162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:45:35.937143 22162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:35.937649 22162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 38689 } }
I20260619 02:45:35.937732 22162 leader_election.cc:302] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e359c2a27f1486e9b8bcf8ce570b7f1; no voters:
I20260619 02:45:35.937893 22162 leader_election.cc:288] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:45:35.937924 22167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:35.938022 22167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [term 1 LEADER]: Becoming Leader. State: Replica: 1e359c2a27f1486e9b8bcf8ce570b7f1, State: Running, Role: LEADER
I20260619 02:45:35.938098 22167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 38689 } }
I20260619 02:45:35.938144 22162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:45:35.938400 22167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 38689 } } }
I20260619 02:45:35.938604 22167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:35.938807 22167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e359c2a27f1486e9b8bcf8ce570b7f1. Latest consensus state: current_term: 1 leader_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e359c2a27f1486e9b8bcf8ce570b7f1" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 38689 } } }
I20260619 02:45:35.938881 22167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1 [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:35.939188 22176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:45:35.939751 22176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:45:35.941381 22176 catalog_manager.cc:1347] Generated new cluster ID: deda60e64b204dbbb797d405c61ad133
I20260619 02:45:35.941439 22176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:45:35.942265 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:35.936622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47958 (local address 127.12.145.126:38689)
0619 02:45:35.936836 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:35.936845 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:35.936895 (+ 50us) server_negotiation.cc:407] Connection header received
0619 02:45:35.937006 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:35.937011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:35.937089 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:35.937231 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:35.937411 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.939088 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.940159 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:35.940751 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:35.940863 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:35.941588 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:35.941592 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:35.941592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:35.941789 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:35.941825 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:35.941838 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:35.941897 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:35.942000 (+ 103us) server_negotiation.cc:299] Negotiation successful
0619 02:45:35.942070 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260619 02:45:35.950639 22176 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:45:35.951097 22176 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:45:35.963137 22176 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e359c2a27f1486e9b8bcf8ce570b7f1: Generated new TSK 0
I20260619 02:45:35.963307 22176 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:45:35.968014 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:38689
--builtin_ntp_servers=127.12.145.84:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260619 02:45:36.050704 22186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:36.050899 22186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:36.050920 22186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:36.052052 22186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:36.052090 22186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:36.052114 22186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:45:36.053404 22186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:38689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:36.053634 22186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:36.053921 22186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:36.059531 22194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.059566 22191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.059531 22192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:36.059891 22186 server_base.cc:1034] running on GCE node
I20260619 02:45:36.060102 22186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:36.060343 22186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:36.061506 22186 hybrid_clock.cc:648] HybridClock initialized: now 1781837136061496 us; error 32 us; skew 500 ppm
I20260619 02:45:36.062853 22186 webserver.cc:460] Webserver started at http://127.12.145.65:34045/ using document root <none> and password file <none>
I20260619 02:45:36.063082 22186 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:36.063163 22186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:36.063315 22186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:36.064371 22186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "cb65f8a8bc814a7ca23ad3cc6cd68276"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "bdb8507d3b70781005fc962391aa14bc"
server_key_iv: "4fc31261b415a1e0aa10ed3024b95ac5"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.064720 22186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "cb65f8a8bc814a7ca23ad3cc6cd68276"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "bdb8507d3b70781005fc962391aa14bc"
server_key_iv: "4fc31261b415a1e0aa10ed3024b95ac5"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.065995 22186 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:45:36.066773 22200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.066989 22186 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:45:36.067082 22186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "cb65f8a8bc814a7ca23ad3cc6cd68276"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "bdb8507d3b70781005fc962391aa14bc"
server_key_iv: "4fc31261b415a1e0aa10ed3024b95ac5"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.067150 22186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:36.080317 22186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:36.080557 22186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:36.080662 22186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:36.080823 22186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:36.081073 22186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:36.081103 22186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.081125 22186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:36.081136 22186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.086799 22186 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:41619
I20260619 02:45:36.086856 22313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:41619 every 8 connection(s)
I20260619 02:45:36.087160 22186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:45:36.092167 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.087850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:58413 (local address 127.12.145.126:38689)
0619 02:45:36.087914 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.087916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.088154 (+ 238us) server_negotiation.cc:407] Connection header received
0619 02:45:36.088675 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.088676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.088689 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.088750 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.089376 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.089877 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.090852 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.091066 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.091167 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:36.091887 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:36.091888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:36.091889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:36.091894 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:36.091907 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:36.091911 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:36.091955 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:36.092050 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 02:45:36.092081 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260619 02:45:36.092351 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.087848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:38689 (local address 127.12.145.65:58413)
0619 02:45:36.088033 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:36.088064 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:36.088553 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:36.088822 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:36.088825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:36.088833 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:36.089279 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:36.089282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.089966 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.089967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:36.090759 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:36.090761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.091178 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.091179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:36.091308 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:36.091755 (+ 447us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:45:36.091755 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:36.091780 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:45:36.091801 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:36.091965 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:36.091969 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:36.091972 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:45:36.092053 (+ 81us) client_negotiation.cc:240] Negotiation successful
0619 02:45:36.092149 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":87,"threads_started":1}
I20260619 02:45:36.092831 22314 heartbeater.cc:347] Connected to a master server at 127.12.145.126:38689
I20260619 02:45:36.092914 22314 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:36.093042 22314 heartbeater.cc:511] Master 127.12.145.126:38689 requested a full tablet report, sending...
I20260619 02:45:36.093298 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22186
I20260619 02:45:36.093385 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:45:36.093554 22126 ts_manager.cc:194] Registered new tserver with Master: cb65f8a8bc814a7ca23ad3cc6cd68276 (127.12.145.65:41619)
I20260619 02:45:36.093586 12869 external_mini_cluster.cc:1428] Setting key 97927a57115a523a2fd6bc09bb803e96
I20260619 02:45:36.094302 22126 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.65:58413
I20260619 02:45:36.094789 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:38689
--builtin_ntp_servers=127.12.145.84:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260619 02:45:36.173362 22317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:36.173581 22317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:36.173615 22317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:36.174765 22317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:36.174829 22317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:36.174870 22317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:45:36.176152 22317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:38689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:36.176411 22317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:36.176714 22317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:36.181561 22322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.181594 22325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.181552 22323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:36.181774 22317 server_base.cc:1034] running on GCE node
I20260619 02:45:36.181996 22317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:36.182185 22317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:36.183315 22317 hybrid_clock.cc:648] HybridClock initialized: now 1781837136183296 us; error 36 us; skew 500 ppm
I20260619 02:45:36.184481 22317 webserver.cc:460] Webserver started at http://127.12.145.66:40679/ using document root <none> and password file <none>
I20260619 02:45:36.184679 22317 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:36.184721 22317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:36.184849 22317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:36.185850 22317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "433d4e5a2c7e4ce1acb7ae413bba5448"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "9686d802ad0b010722a975e7122247e0"
server_key_iv: "48e2bd1ec408e18fefe65c741d1f7ab0"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.186141 22317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "433d4e5a2c7e4ce1acb7ae413bba5448"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "9686d802ad0b010722a975e7122247e0"
server_key_iv: "48e2bd1ec408e18fefe65c741d1f7ab0"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.187395 22317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:45:36.188097 22331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.188308 22317 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:45:36.188396 22317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "433d4e5a2c7e4ce1acb7ae413bba5448"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "9686d802ad0b010722a975e7122247e0"
server_key_iv: "48e2bd1ec408e18fefe65c741d1f7ab0"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.188449 22317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:36.208792 22317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:36.209045 22317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:36.209146 22317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:36.209321 22317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:36.209704 22317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:36.209743 22317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.209764 22317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:36.209806 22317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.215332 22317 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34197
I20260619 02:45:36.215389 22444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34197 every 8 connection(s)
I20260619 02:45:36.215695 22317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:45:36.219147 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22317
I20260619 02:45:36.219239 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:45:36.219434 12869 external_mini_cluster.cc:1428] Setting key bcacf22887212b2d08835fcd38086dca
I20260619 02:45:36.220445 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:38689
--builtin_ntp_servers=127.12.145.84:38233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260619 02:45:36.220968 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.216473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:50153 (local address 127.12.145.126:38689)
0619 02:45:36.216531 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.216533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.216722 (+ 189us) server_negotiation.cc:407] Connection header received
0619 02:45:36.217174 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.217175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.217187 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.217247 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.217869 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.218351 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.219517 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.219789 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.219841 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:36.220700 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:36.220701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:36.220702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:36.220707 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:36.220728 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:36.220732 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:36.220778 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:36.220890 (+ 112us) server_negotiation.cc:299] Negotiation successful
0619 02:45:36.220913 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260619 02:45:36.221256 22447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.216356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:38689 (local address 127.12.145.66:50153)
0619 02:45:36.216602 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:36.216640 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:36.217090 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:36.217314 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:36.217317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:36.217325 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:36.217802 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:36.217806 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.218429 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.218429 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:36.219435 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:36.219437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.219851 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.219852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:36.219996 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:36.220525 (+ 529us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:45:36.220526 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:36.220564 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:45:36.220593 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:36.220798 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:36.220803 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:36.220806 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:45:36.220888 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 02:45:36.220998 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
I20260619 02:45:36.221757 22445 heartbeater.cc:347] Connected to a master server at 127.12.145.126:38689
I20260619 02:45:36.221851 22445 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:36.222028 22445 heartbeater.cc:511] Master 127.12.145.126:38689 requested a full tablet report, sending...
I20260619 02:45:36.222404 22126 ts_manager.cc:194] Registered new tserver with Master: 433d4e5a2c7e4ce1acb7ae413bba5448 (127.12.145.66:34197)
I20260619 02:45:36.222816 22126 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.66:50153
W20260619 02:45:36.299762 22448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:36.299943 22448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:36.299962 22448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:36.301039 22448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:36.301077 22448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:36.301101 22448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:45:36.302357 22448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:38689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:36.302603 22448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:36.302874 22448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:36.307654 22453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.307657 22456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.307674 22454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:36.307760 22448 server_base.cc:1034] running on GCE node
I20260619 02:45:36.308072 22448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:36.308320 22448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:36.309477 22448 hybrid_clock.cc:648] HybridClock initialized: now 1781837136309468 us; error 36 us; skew 500 ppm
I20260619 02:45:36.310855 22448 webserver.cc:460] Webserver started at http://127.12.145.67:37577/ using document root <none> and password file <none>
I20260619 02:45:36.311121 22448 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:36.311215 22448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:36.311367 22448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:36.312394 22448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "b2fe6fc2001b40948c461b83db3aa13d"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "2ddc4de53b1b88fda25135b2a3567cd4"
server_key_iv: "0c282a0e7c87782d2e864cbefad211b3"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.312741 22448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "b2fe6fc2001b40948c461b83db3aa13d"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "2ddc4de53b1b88fda25135b2a3567cd4"
server_key_iv: "0c282a0e7c87782d2e864cbefad211b3"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.313938 22448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:45:36.314700 22462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.314872 22448 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:36.314952 22448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "b2fe6fc2001b40948c461b83db3aa13d"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "2ddc4de53b1b88fda25135b2a3567cd4"
server_key_iv: "0c282a0e7c87782d2e864cbefad211b3"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.315037 22448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:36.337806 22448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:36.338100 22448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:36.338250 22448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:36.338485 22448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:36.338829 22448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:36.338899 22448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.338940 22448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:36.338966 22448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.344518 22448 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:35637
I20260619 02:45:36.344552 22575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:35637 every 8 connection(s)
I20260619 02:45:36.344887 22448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:45:36.345281 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22448
I20260619 02:45:36.345378 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:45:36.345619 12869 external_mini_cluster.cc:1428] Setting key 07f667cf1131a2d7887b1f98897c56fe
I20260619 02:45:36.349887 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.345608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:42263 (local address 127.12.145.126:38689)
0619 02:45:36.345683 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.345686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.345941 (+ 255us) server_negotiation.cc:407] Connection header received
0619 02:45:36.346468 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.346470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.346481 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.346534 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.347200 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.347693 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.348633 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.348840 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.348913 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:36.349626 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:36.349628 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:36.349628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:36.349633 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:36.349646 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:36.349651 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:36.349697 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:36.349785 (+ 88us) server_negotiation.cc:299] Negotiation successful
0619 02:45:36.349812 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:45:36.350076 22578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.345588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:38689 (local address 127.12.145.67:42263)
0619 02:45:36.345778 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:36.345816 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:36.346368 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:36.346626 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:36.346630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:36.346640 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:36.347101 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:36.347106 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.347785 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.347786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:36.348539 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:36.348541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:36.348918 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:36.348919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:36.349047 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:36.349489 (+ 442us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:45:36.349489 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:36.349514 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:45:36.349535 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:36.349696 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:36.349700 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:36.349703 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:45:36.349788 (+ 85us) client_negotiation.cc:240] Negotiation successful
0619 02:45:36.349879 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260619 02:45:36.350481 22576 heartbeater.cc:347] Connected to a master server at 127.12.145.126:38689
I20260619 02:45:36.350600 22576 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:36.350747 22576 heartbeater.cc:511] Master 127.12.145.126:38689 requested a full tablet report, sending...
I20260619 02:45:36.351086 22126 ts_manager.cc:194] Registered new tserver with Master: b2fe6fc2001b40948c461b83db3aa13d (127.12.145.67:35637)
I20260619 02:45:36.351455 22126 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.67:42263
I20260619 02:45:36.357123 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 02:45:36.358820 22166 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:36.358332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47964 (local address 127.12.145.126:38689)
0619 02:45:36.358386 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.358388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.358468 (+ 80us) server_negotiation.cc:407] Connection header received
0619 02:45:36.358529 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.358530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.358537 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.358630 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.358747 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47964: BlockingRecv error: recv got EOF from 127.0.0.1:47964 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:45:36.358922 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22186
I20260619 02:45:36.363394 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22317
I20260619 02:45:36.367372 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22448
I20260619 02:45:36.371312 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22095
2026-06-19T02:45:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (584 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-06-19T02:45:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:45:36Z Disabled control of system clock
I20260619 02:45:36.396988 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39489
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:34415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:39489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260619 02:45:36.475036 22587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:36.475224 22587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:36.475244 22587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:36.476367 22587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:45:36.476403 22587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:36.476415 22587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:36.476428 22587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:45:36.476472 22587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:45:36.477783 22587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:39489
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:36.478021 22587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:36.478334 22587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:36.482793 22593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.482810 22592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.482795 22595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:36.482963 22587 server_base.cc:1034] running on GCE node
I20260619 02:45:36.483237 22587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:36.483531 22587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:36.484692 22587 hybrid_clock.cc:648] HybridClock initialized: now 1781837136484665 us; error 42 us; skew 500 ppm
I20260619 02:45:36.485941 22587 webserver.cc:460] Webserver started at http://127.12.145.126:39257/ using document root <none> and password file <none>
I20260619 02:45:36.486186 22587 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:36.486251 22587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:36.486398 22587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:36.487423 22587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "909630b1c368473caa9a463a34cee91f"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "06e9ce96ca6042724dfeccf12dd1703f"
server_key_iv: "dce1018aacc2cf5cb3c63b579cae5be1"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.487785 22587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "909630b1c368473caa9a463a34cee91f"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "06e9ce96ca6042724dfeccf12dd1703f"
server_key_iv: "dce1018aacc2cf5cb3c63b579cae5be1"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.488992 22587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:45:36.489667 22601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.489827 22587 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:36.489918 22587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "909630b1c368473caa9a463a34cee91f"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "06e9ce96ca6042724dfeccf12dd1703f"
server_key_iv: "dce1018aacc2cf5cb3c63b579cae5be1"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.489996 22587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:36.493011 22587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:36.493233 22587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:36.493361 22587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:36.497089 22587 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:39489
I20260619 02:45:36.497112 22653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:39489 every 8 connection(s)
I20260619 02:45:36.497417 22587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:45:36.498026 22654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:36.500453 22654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f: Bootstrap starting.
I20260619 02:45:36.500705 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22587
I20260619 02:45:36.500799 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:45:36.500993 12869 external_mini_cluster.cc:1428] Setting key 2cc3e4bce04a685867d4e6db07fb5a15
I20260619 02:45:36.501139 22654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:36.501528 22654 log.cc:824] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:36.502182 22654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f: No bootstrap required, opened a new log
I20260619 02:45:36.503384 22657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.501497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56534 (local address 127.12.145.126:39489)
0619 02:45:36.501681 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.501690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.501718 (+ 28us) server_negotiation.cc:407] Connection header received
0619 02:45:36.502122 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.502128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.502161 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.502312 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.502950 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:36.502953 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:36.502953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:36.502957 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:36.502995 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:36.503005 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:36.503072 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:36.503143 (+ 71us) server_negotiation.cc:299] Negotiation successful
0619 02:45:36.503208 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":90,"threads_started":1}
I20260619 02:45:36.504030 22654 raft_consensus.cc:348] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909630b1c368473caa9a463a34cee91f" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39489 } }
I20260619 02:45:36.504166 22654 raft_consensus.cc:374] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:36.504187 22654 raft_consensus.cc:729] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 909630b1c368473caa9a463a34cee91f, State: Initialized, Role: FOLLOWER
I20260619 02:45:36.504285 22654 consensus_queue.cc:260] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909630b1c368473caa9a463a34cee91f" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39489 } }
I20260619 02:45:36.504347 22654 raft_consensus.cc:388] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:45:36.504365 22654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:45:36.504390 22654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:36.505081 22654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909630b1c368473caa9a463a34cee91f" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39489 } }
I20260619 02:45:36.505167 22654 leader_election.cc:302] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 909630b1c368473caa9a463a34cee91f; no voters:
I20260619 02:45:36.505273 22654 leader_election.cc:288] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:45:36.505307 22659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:36.505489 22659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [term 1 LEADER]: Becoming Leader. State: Replica: 909630b1c368473caa9a463a34cee91f, State: Running, Role: LEADER
I20260619 02:45:36.505577 22654 sys_catalog.cc:564] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:45:36.505589 22659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909630b1c368473caa9a463a34cee91f" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39489 } }
I20260619 02:45:36.505935 22661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 909630b1c368473caa9a463a34cee91f. Latest consensus state: current_term: 1 leader_uuid: "909630b1c368473caa9a463a34cee91f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909630b1c368473caa9a463a34cee91f" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39489 } } }
I20260619 02:45:36.505944 22660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "909630b1c368473caa9a463a34cee91f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909630b1c368473caa9a463a34cee91f" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39489 } } }
I20260619 02:45:36.506057 22661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:36.506063 22660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:36.506318 22666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:45:36.506860 22666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:45:36.508452 22666 catalog_manager.cc:1347] Generated new cluster ID: 045dff9bca6e4651aff414cd59c370b0
I20260619 02:45:36.508496 22666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:45:36.519200 22666 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:45:36.519378 22666 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:45:36.523626 22666 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 909630b1c368473caa9a463a34cee91f: Generated new TSK 0
I20260619 02:45:36.523854 22666 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:45:36.525875 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39489
--builtin_ntp_servers=127.12.145.84:34415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260619 02:45:36.605383 22678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:36.605608 22678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:36.605644 22678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:36.607043 22678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:36.607111 22678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:36.607154 22678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:45:36.608476 22678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:36.608745 22678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:36.609045 22678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:36.614611 22684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.614621 22683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.614645 22686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:36.615348 22678 server_base.cc:1034] running on GCE node
I20260619 02:45:36.615559 22678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:36.615799 22678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:36.616966 22678 hybrid_clock.cc:648] HybridClock initialized: now 1781837136616941 us; error 40 us; skew 500 ppm
I20260619 02:45:36.621328 22678 webserver.cc:460] Webserver started at http://127.12.145.65:43373/ using document root <none> and password file <none>
I20260619 02:45:36.621562 22678 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:36.621639 22678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:36.621788 22678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:36.622856 22678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "cc51a0dcf7304b82936e4667d83817fb"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "b79a7d964693b037bc7b9141068dca59"
server_key_iv: "4df94d28fab419f8fbcad04f05b7f8fb"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.623204 22678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "cc51a0dcf7304b82936e4667d83817fb"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "b79a7d964693b037bc7b9141068dca59"
server_key_iv: "4df94d28fab419f8fbcad04f05b7f8fb"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.624505 22678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:45:36.625236 22692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.625398 22678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:36.625494 22678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "cc51a0dcf7304b82936e4667d83817fb"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "b79a7d964693b037bc7b9141068dca59"
server_key_iv: "4df94d28fab419f8fbcad04f05b7f8fb"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.625571 22678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:36.628862 22678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:36.629113 22678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:36.629257 22678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:36.629456 22678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:36.629752 22678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:36.629805 22678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.629843 22678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:36.629869 22678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.635373 22678 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:44163
I20260619 02:45:36.635440 22805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:44163 every 8 connection(s)
I20260619 02:45:36.635736 22678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:45:36.638381 22657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.636397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:38465 (local address 127.12.145.126:39489)
0619 02:45:36.636475 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.636477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.636640 (+ 163us) server_negotiation.cc:407] Connection header received
0619 02:45:36.637135 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.637136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.637141 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.637202 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.638196 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:36.638197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:36.638197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:36.638201 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:36.638212 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:36.638216 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:36.638259 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:36.638323 (+ 64us) server_negotiation.cc:299] Negotiation successful
0619 02:45:36.638334 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260619 02:45:36.638654 22808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.636366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39489 (local address 127.12.145.65:38465)
0619 02:45:36.636533 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:36.636562 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:36.637047 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:36.637251 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:36.637254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:36.637261 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:36.638067 (+ 806us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:45:36.638067 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:36.638092 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:45:36.638123 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:36.638257 (+ 134us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:36.638259 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:36.638261 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:45:36.638322 (+ 61us) client_negotiation.cc:240] Negotiation successful
0619 02:45:36.638366 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260619 02:45:36.639127 22806 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39489
I20260619 02:45:36.639219 22806 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:36.639350 22806 heartbeater.cc:511] Master 127.12.145.126:39489 requested a full tablet report, sending...
I20260619 02:45:36.639792 22618 ts_manager.cc:194] Registered new tserver with Master: cc51a0dcf7304b82936e4667d83817fb (127.12.145.65:44163)
I20260619 02:45:36.640695 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22678
I20260619 02:45:36.640764 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:45:36.640904 12869 external_mini_cluster.cc:1428] Setting key 9db057bc6cb99a1d9651bb6b2ca7e073
I20260619 02:45:36.641685 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39489
--builtin_ntp_servers=127.12.145.84:34415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260619 02:45:36.719827 22809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:36.720014 22809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:36.720036 22809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:36.721057 22809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:36.721088 22809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:36.721119 22809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:45:36.722347 22809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:36.722528 22809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:36.722824 22809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:36.727545 22815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.727553 22817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.727612 22814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:36.727679 22809 server_base.cc:1034] running on GCE node
I20260619 02:45:36.728022 22809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:36.728281 22809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:36.729458 22809 hybrid_clock.cc:648] HybridClock initialized: now 1781837136729440 us; error 41 us; skew 500 ppm
I20260619 02:45:36.730806 22809 webserver.cc:460] Webserver started at http://127.12.145.66:35777/ using document root <none> and password file <none>
I20260619 02:45:36.731058 22809 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:36.731128 22809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:36.731287 22809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:36.732308 22809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "8adf38cfba5b44d5968602896b47d764"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "e30c920689a4dabc9e730546d9da689b"
server_key_iv: "c9244ffaf8a35b20dce0f5a1a6312be2"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.732657 22809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "8adf38cfba5b44d5968602896b47d764"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "e30c920689a4dabc9e730546d9da689b"
server_key_iv: "c9244ffaf8a35b20dce0f5a1a6312be2"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.733927 22809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:45:36.734683 22823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.734849 22809 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:36.734944 22809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "8adf38cfba5b44d5968602896b47d764"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "e30c920689a4dabc9e730546d9da689b"
server_key_iv: "c9244ffaf8a35b20dce0f5a1a6312be2"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.735026 22809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:36.738168 22809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:36.738445 22809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:36.738608 22809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:36.738819 22809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:36.739117 22809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:36.739168 22809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.739204 22809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:36.739249 22809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.744621 22809 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34347
I20260619 02:45:36.744657 22936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34347 every 8 connection(s)
I20260619 02:45:36.744959 22809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:45:36.745810 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22809
I20260619 02:45:36.745913 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:45:36.746088 12869 external_mini_cluster.cc:1428] Setting key c926b82ca38ef096b4592f6cf3f042b1
I20260619 02:45:36.747485 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39489
--builtin_ntp_servers=127.12.145.84:34415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260619 02:45:36.748168 22657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.745639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:51037 (local address 127.12.145.126:39489)
0619 02:45:36.745717 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.745720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.745913 (+ 193us) server_negotiation.cc:407] Connection header received
0619 02:45:36.746480 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.746481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.746486 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.746533 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.747945 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:36.747946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:36.747947 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:36.747951 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:36.747965 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:36.747970 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:36.748021 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:36.748084 (+ 63us) server_negotiation.cc:299] Negotiation successful
0619 02:45:36.748097 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 02:45:36.748382 22939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.745580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39489 (local address 127.12.145.66:51037)
0619 02:45:36.745804 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:36.745841 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:36.746385 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:36.746636 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:36.746640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:36.746648 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:36.747799 (+ 1151us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:45:36.747799 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:36.747826 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:45:36.747852 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:36.748019 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:36.748023 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:36.748026 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:45:36.748119 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 02:45:36.748177 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":84,"threads_started":1}
I20260619 02:45:36.748863 22937 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39489
I20260619 02:45:36.748957 22937 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:36.749107 22937 heartbeater.cc:511] Master 127.12.145.126:39489 requested a full tablet report, sending...
I20260619 02:45:36.749432 22618 ts_manager.cc:194] Registered new tserver with Master: 8adf38cfba5b44d5968602896b47d764 (127.12.145.66:34347)
W20260619 02:45:36.826293 22940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:36.826478 22940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:36.826498 22940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:36.827657 22940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:36.827698 22940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:36.827723 22940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:45:36.829051 22940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:36.829234 22940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:36.829515 22940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:36.834023 22946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.834044 22948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:36.834044 22945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:36.834298 22940 server_base.cc:1034] running on GCE node
I20260619 02:45:36.834642 22940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:36.834874 22940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:36.836050 22940 hybrid_clock.cc:648] HybridClock initialized: now 1781837136836042 us; error 39 us; skew 500 ppm
I20260619 02:45:36.837262 22940 webserver.cc:460] Webserver started at http://127.12.145.67:32863/ using document root <none> and password file <none>
I20260619 02:45:36.837496 22940 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:36.837563 22940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:36.837713 22940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:36.838845 22940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "eff12e2a750b4018ad941c2325a559cd"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "09607c71584644971327707f2c615a5b"
server_key_iv: "f7c59cc3cc5c350fd99863170849b914"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.839182 22940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "eff12e2a750b4018ad941c2325a559cd"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "09607c71584644971327707f2c615a5b"
server_key_iv: "f7c59cc3cc5c350fd99863170849b914"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.840416 22940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:45:36.841073 22954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.841255 22940 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:36.841346 22940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "eff12e2a750b4018ad941c2325a559cd"
format_stamp: "Formatted at 2026-06-19 02:45:36 on dist-test-slave-fbl4"
server_key: "09607c71584644971327707f2c615a5b"
server_key_iv: "f7c59cc3cc5c350fd99863170849b914"
server_key_version: "encryptionkey@0"
I20260619 02:45:36.841425 22940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:36.844590 22940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:36.844830 22940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:36.844954 22940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:36.845147 22940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:36.845422 22940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:36.845470 22940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.845507 22940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:36.845533 22940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:36.850895 22940 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:38649
I20260619 02:45:36.850932 23067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:38649 every 8 connection(s)
I20260619 02:45:36.851243 22940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:45:36.852730 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 22940
I20260619 02:45:36.852838 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:45:36.853020 12869 external_mini_cluster.cc:1428] Setting key 234a565b726c6ebd390d5a55064b7071
I20260619 02:45:36.854136 22657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.851917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:40757 (local address 127.12.145.126:39489)
0619 02:45:36.851960 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.851962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.852173 (+ 211us) server_negotiation.cc:407] Connection header received
0619 02:45:36.852596 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.852597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.852604 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.852676 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.853953 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:36.853954 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:36.853954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:45:36.853957 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:36.853980 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:45:36.853984 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:36.854025 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:36.854071 (+ 46us) server_negotiation.cc:299] Negotiation successful
0619 02:45:36.854081 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:45:36.854300 23070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:36.851885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39489 (local address 127.12.145.67:40757)
0619 02:45:36.852047 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:36.852082 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:36.852502 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:36.852733 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:36.852736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:36.852744 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:36.853840 (+ 1096us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:45:36.853841 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:36.853865 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:45:36.853888 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:36.854025 (+ 137us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:36.854028 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:36.854030 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:45:36.854076 (+ 46us) client_negotiation.cc:240] Negotiation successful
0619 02:45:36.854124 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":82,"threads_started":1}
I20260619 02:45:36.854756 23068 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39489
I20260619 02:45:36.854858 23068 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:36.854995 23068 heartbeater.cc:511] Master 127.12.145.126:39489 requested a full tablet report, sending...
I20260619 02:45:36.855307 22618 ts_manager.cc:194] Registered new tserver with Master: eff12e2a750b4018ad941c2325a559cd (127.12.145.67:38649)
I20260619 02:45:36.864677 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 02:45:36.866951 22657 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:36.866139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56550 (local address 127.12.145.126:39489)
0619 02:45:36.866625 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:36.866627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:36.866636 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:36.866672 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:36.866673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:36.866677 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:36.866737 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:36.866892 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56550: BlockingRecv error: recv got EOF from 127.0.0.1:56550 (error 108)
Metrics: {"server-negotiator.queue_time_us":458}
I20260619 02:45:36.867384 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22678
I20260619 02:45:36.872324 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22809
I20260619 02:45:36.876138 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22940
I20260619 02:45:36.880134 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 22587
2026-06-19T02:45:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (508 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:45:36 dist-test-slave-fbl4 krb5kdc[23078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:45:36 dist-test-slave-fbl4 krb5kdc[23078](info): set up 2 sockets
Jun 19 02:45:36 dist-test-slave-fbl4 krb5kdc[23078](info): commencing operation
krb5kdc: starting...
W20260619 02:45:37.910710 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:45:37 dist-test-slave-fbl4 krb5kdc[23078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:45:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:45:38.019402 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:35073
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:44401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:35073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:38.097829 23091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:38.098045 23091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:38.098079 23091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:38.099261 23091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:45:38.099320 23091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:38.099345 23091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:38.099378 23091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:45:38.099403 23091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:45:38.100893 23091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:35073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:35073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:38.101161 23091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:38.101374 23091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:38.105931 23096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:38.105990 23097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:38.105985 23099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:38.106082 23091 server_base.cc:1034] running on GCE node
I20260619 02:45:38.106377 23091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:38.106684 23091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:38.107825 23091 hybrid_clock.cc:648] HybridClock initialized: now 1781837138107801 us; error 40 us; skew 500 ppm
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837138, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:38.110208 23091 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:45:38.110626 23091 webserver.cc:460] Webserver started at http://127.12.145.126:45839/ using document root <none> and password file <none>
I20260619 02:45:38.110819 23091 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:38.110860 23091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:38.110944 23091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:38.111860 23091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "e13cca47dd314b52a16583363ecea96e"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "8301fd47d7e8aa7a53ebe706e48115ab"
server_key_iv: "7a3017f0fe866e7b34588a0ce09ae8b0"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.112138 23091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "e13cca47dd314b52a16583363ecea96e"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "8301fd47d7e8aa7a53ebe706e48115ab"
server_key_iv: "7a3017f0fe866e7b34588a0ce09ae8b0"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.113320 23091 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:45:38.113943 23106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.114112 23091 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.114209 23091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "e13cca47dd314b52a16583363ecea96e"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "8301fd47d7e8aa7a53ebe706e48115ab"
server_key_iv: "7a3017f0fe866e7b34588a0ce09ae8b0"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.114286 23091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:38.134446 23091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:38.136196 23091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:38.136356 23091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:38.140100 23091 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:35073
I20260619 02:45:38.140148 23158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:35073 every 8 connection(s)
I20260619 02:45:38.140481 23091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:45:38.141410 23159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:38.143370 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 23091
I20260619 02:45:38.143486 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:45:38.143669 12869 external_mini_cluster.cc:1428] Setting key a92bd76dfdc2805079c1cd2cceab3f81
I20260619 02:45:38.143699 23159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e: Bootstrap starting.
I20260619 02:45:38.144332 23159 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:38.144624 23159 log.cc:824] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:38.145289 23159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e: No bootstrap required, opened a new log
I20260619 02:45:38.147104 23159 raft_consensus.cc:348] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13cca47dd314b52a16583363ecea96e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35073 } }
I20260619 02:45:38.147253 23159 raft_consensus.cc:374] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:38.147300 23159 raft_consensus.cc:729] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13cca47dd314b52a16583363ecea96e, State: Initialized, Role: FOLLOWER
I20260619 02:45:38.147468 23159 consensus_queue.cc:260] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13cca47dd314b52a16583363ecea96e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35073 } }
I20260619 02:45:38.147571 23159 raft_consensus.cc:388] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:45:38.147609 23159 raft_consensus.cc:482] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:45:38.147660 23159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:38.148162 23159 raft_consensus.cc:504] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13cca47dd314b52a16583363ecea96e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35073 } }
I20260619 02:45:38.148277 23159 leader_election.cc:302] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e13cca47dd314b52a16583363ecea96e; no voters:
I20260619 02:45:38.148443 23159 leader_election.cc:288] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:45:38.148615 23165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:38.148705 23159 sys_catalog.cc:564] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:45:38.148839 23165 raft_consensus.cc:686] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [term 1 LEADER]: Becoming Leader. State: Replica: e13cca47dd314b52a16583363ecea96e, State: Running, Role: LEADER
I20260619 02:45:38.148978 23165 consensus_queue.cc:237] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13cca47dd314b52a16583363ecea96e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35073 } }
I20260619 02:45:38.149394 23164 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e13cca47dd314b52a16583363ecea96e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13cca47dd314b52a16583363ecea96e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35073 } } }
I20260619 02:45:38.149475 23164 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:38.149634 23166 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e13cca47dd314b52a16583363ecea96e. Latest consensus state: current_term: 1 leader_uuid: "e13cca47dd314b52a16583363ecea96e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13cca47dd314b52a16583363ecea96e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35073 } } }
I20260619 02:45:38.149713 23166 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e [sys.catalog]: This master's current role is: LEADER
I20260619 02:45:38.149678 23173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:45:38.150275 23173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:45:38.151937 23173 catalog_manager.cc:1347] Generated new cluster ID: 93a411dd9c8f4648b437c636c098e605
I20260619 02:45:38.151990 23173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:45:38.154676 23162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.144159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38286 (local address 127.12.145.126:35073)
0619 02:45:38.144336 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.144345 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.144392 (+ 47us) server_negotiation.cc:407] Connection header received
0619 02:45:38.144938 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.144947 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.145007 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.145156 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:38.145811 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.146727 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.147580 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.148048 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.148191 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.151053 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:38.151056 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:38.151057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:38.151068 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:38.153038 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.153419 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.153423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.153423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.153527 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.153727 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.153728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.153728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.154043 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:38.154197 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.154289 (+ 92us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.154441 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":73,"threads_started":1}
I20260619 02:45:38.160400 23173 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:45:38.160872 23173 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:45:38.164124 23173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e: Generated new TSK 0
I20260619 02:45:38.164280 23173 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:45:38.193078 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35073
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:44401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:38.282939 23185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:38.283139 23185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:38.283161 23185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:38.284245 23185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:38.284283 23185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:38.284308 23185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:45:38.285775 23185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:38.285998 23185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:38.286242 23185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:38.291026 23190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:38.291052 23193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:38.291226 23185 server_base.cc:1034] running on GCE node
W20260619 02:45:38.291256 23191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:38.291468 23185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:38.291744 23185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:38.292881 23185 hybrid_clock.cc:648] HybridClock initialized: now 1781837138292862 us; error 36 us; skew 500 ppm
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837138, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:38.295339 23185 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:45:38.295735 23185 webserver.cc:460] Webserver started at http://127.12.145.65:43937/ using document root <none> and password file <none>
I20260619 02:45:38.295959 23185 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:38.296003 23185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:38.296167 23185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:38.297151 23185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "8dd3dad68e934a4a995219074fc91836"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "05a66497f6f14108c63ffa8d92165ae6"
server_key_iv: "389f28949c51f0190c97a3e5a1a59b70"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.297518 23185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "8dd3dad68e934a4a995219074fc91836"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "05a66497f6f14108c63ffa8d92165ae6"
server_key_iv: "389f28949c51f0190c97a3e5a1a59b70"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.298828 23185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:45:38.299547 23200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.299723 23185 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:45:38.299822 23185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "8dd3dad68e934a4a995219074fc91836"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "05a66497f6f14108c63ffa8d92165ae6"
server_key_iv: "389f28949c51f0190c97a3e5a1a59b70"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.299898 23185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:38.318127 23185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:38.319859 23185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:38.320006 23185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:38.320214 23185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:38.320492 23185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:38.320544 23185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.320585 23185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:38.320614 23185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.325971 23185 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:45591
I20260619 02:45:38.326040 23313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:45591 every 8 connection(s)
I20260619 02:45:38.326334 23185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:45:38.327720 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 23185
I20260619 02:45:38.327822 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:45:38.328025 12869 external_mini_cluster.cc:1428] Setting key 2f8c4ebddcdb6b22ec15d0a7b83c70cc
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837138, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:45:38.335539 23162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.326948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:44543 (local address 127.12.145.126:35073)
0619 02:45:38.326987 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.326989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.327163 (+ 174us) server_negotiation.cc:407] Connection header received
0619 02:45:38.327666 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.327667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.327681 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.327724 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:38.328847 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.329350 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.330355 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.330608 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.330694 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.332772 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:38.332773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:38.332773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:38.332781 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:38.334179 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.334633 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.334634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.334634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.334692 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.334940 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.334940 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.334941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.335047 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:38.335121 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.335372 (+ 251us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.335451 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
I20260619 02:45:38.335949 23316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.326924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35073 (local address 127.12.145.65:44543)
0619 02:45:38.327048 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.327087 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.327553 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.327805 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.327810 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.328507 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:38.328747 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.328751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.329438 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.329439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.330256 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.330258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.330703 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.330704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.330832 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.331322 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:38.331329 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:38.332679 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:38.334297 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:38.334303 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:38.334305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:38.334510 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:38.334757 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:38.334758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:38.334758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:38.334863 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:38.335112 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:38.335118 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:38.335248 (+ 130us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.335353 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.335493 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":61,"threads_started":1}
I20260619 02:45:38.336549 23314 heartbeater.cc:347] Connected to a master server at 127.12.145.126:35073
I20260619 02:45:38.336640 23314 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:38.336812 23314 heartbeater.cc:511] Master 127.12.145.126:35073 requested a full tablet report, sending...
I20260619 02:45:38.337404 23123 ts_manager.cc:194] Registered new tserver with Master: 8dd3dad68e934a4a995219074fc91836 (127.12.145.65:45591)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
I20260619 02:45:38.338304 23123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:44543
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:45:38.352414 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35073
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:44401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:38.430809 23319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:38.430984 23319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:38.431005 23319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:38.432013 23319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:38.432050 23319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:38.432075 23319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:45:38.433324 23319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:38.433492 23319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:38.433645 23319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:38.438109 23324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:38.438109 23327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:38.438341 23319 server_base.cc:1034] running on GCE node
W20260619 02:45:38.438414 23325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:38.438637 23319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:38.438828 23319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:38.439997 23319 hybrid_clock.cc:648] HybridClock initialized: now 1781837138439980 us; error 29 us; skew 500 ppm
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837138, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:38.442238 23319 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:45:38.442687 23319 webserver.cc:460] Webserver started at http://127.12.145.66:36723/ using document root <none> and password file <none>
I20260619 02:45:38.442894 23319 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:38.442957 23319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:38.443113 23319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:38.444057 23319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "d53283c86d9340adbe2d17929db60726"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "3286f8fa9b4bcce28483c50e30e7c378"
server_key_iv: "4c793beaeee6802a243830cca92b02e9"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.444406 23319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "d53283c86d9340adbe2d17929db60726"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "3286f8fa9b4bcce28483c50e30e7c378"
server_key_iv: "4c793beaeee6802a243830cca92b02e9"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.445619 23319 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:45:38.446321 23334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.446494 23319 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:45:38.446602 23319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "d53283c86d9340adbe2d17929db60726"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "3286f8fa9b4bcce28483c50e30e7c378"
server_key_iv: "4c793beaeee6802a243830cca92b02e9"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.446688 23319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:38.462661 23319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:38.464301 23319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:38.464450 23319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:38.464660 23319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:38.464962 23319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:38.465015 23319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.465055 23319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:38.465111 23319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.470759 23319 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:37271
I20260619 02:45:38.470868 23447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:37271 every 8 connection(s)
I20260619 02:45:38.471144 23319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:45:38.476482 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 23319
I20260619 02:45:38.476605 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:45:38.476805 12869 external_mini_cluster.cc:1428] Setting key 18acd2d0b161e6c8aea9ef241acde952
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837138, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:45:38.480263 23162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.471790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:48199 (local address 127.12.145.126:35073)
0619 02:45:38.471872 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.471874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.472043 (+ 169us) server_negotiation.cc:407] Connection header received
0619 02:45:38.472551 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.472553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.472575 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.472631 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:38.473529 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.474043 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.475045 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.475263 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.475377 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.477673 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:38.477674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:38.477675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:38.477682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:38.478957 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.479336 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.479337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.479337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.479394 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.479647 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.479648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.479649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.479761 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:38.479833 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.480095 (+ 262us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.480179 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:45:38.480422 23450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.471745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35073 (local address 127.12.145.66:48199)
0619 02:45:38.471917 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.471962 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.472448 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.472695 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.472699 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.473247 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:38.473432 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.473435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.474141 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.474142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.474945 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.474947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.475379 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.475380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.475516 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.475930 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:38.475938 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:38.477575 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:38.479048 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:38.479053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:38.479055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:38.479261 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:38.479467 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:38.479468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:38.479468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:38.479572 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:38.479836 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:38.479843 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:38.479971 (+ 128us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.480072 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.480210 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260619 02:45:38.480825 23448 heartbeater.cc:347] Connected to a master server at 127.12.145.126:35073
I20260619 02:45:38.480907 23448 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:38.481079 23448 heartbeater.cc:511] Master 127.12.145.126:35073 requested a full tablet report, sending...
I20260619 02:45:38.481446 23123 ts_manager.cc:194] Registered new tserver with Master: d53283c86d9340adbe2d17929db60726 (127.12.145.66:37271)
I20260619 02:45:38.481794 23123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:48199
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:45:38.499305 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35073
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:44401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:45:38.578486 23453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:45:38.578729 23453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:45:38.578751 23453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:45:38.579881 23453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:45:38.579919 23453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:45:38.579944 23453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:45:38.581329 23453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:35073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:45:38.581544 23453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:45:38.581758 23453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:45:38.586601 23461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:38.586637 23459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:45:38.586735 23458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:45:38.586781 23453 server_base.cc:1034] running on GCE node
I20260619 02:45:38.587035 23453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:45:38.587309 23453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:45:38.588457 23453 hybrid_clock.cc:648] HybridClock initialized: now 1781837138588446 us; error 28 us; skew 500 ppm
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837138, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:45:38.590956 23453 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:45:38.591372 23453 webserver.cc:460] Webserver started at http://127.12.145.67:36823/ using document root <none> and password file <none>
I20260619 02:45:38.591586 23453 fs_manager.cc:359] Metadata directory not provided
I20260619 02:45:38.591629 23453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:45:38.591774 23453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:45:38.592784 23453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "20087e702fbb49e29e6a9a32efadb204"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "e42ccac14cba72dafba83aecf8f71134"
server_key_iv: "2df339cb139c4c83ec22d4e8f5000198"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.593135 23453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "20087e702fbb49e29e6a9a32efadb204"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "e42ccac14cba72dafba83aecf8f71134"
server_key_iv: "2df339cb139c4c83ec22d4e8f5000198"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.594390 23453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:45:38.595140 23468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.595319 23453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.595403 23453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "20087e702fbb49e29e6a9a32efadb204"
format_stamp: "Formatted at 2026-06-19 02:45:38 on dist-test-slave-fbl4"
server_key: "e42ccac14cba72dafba83aecf8f71134"
server_key_iv: "2df339cb139c4c83ec22d4e8f5000198"
server_key_version: "encryptionkey@0"
I20260619 02:45:38.595468 23453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:45:38.616293 23453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:45:38.618513 23453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:45:38.618722 23453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:45:38.618935 23453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:45:38.619251 23453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:45:38.619283 23453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.619326 23453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:45:38.619354 23453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:45:38.625101 23453 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:42763
I20260619 02:45:38.625156 23581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:42763 every 8 connection(s)
I20260619 02:45:38.625430 23453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837138, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:45:38.633849 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 23453
I20260619 02:45:38.633981 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:45:38.634040 23162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.626098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:48337 (local address 127.12.145.126:35073)
0619 02:45:38.626142 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.626144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.626332 (+ 188us) server_negotiation.cc:407] Connection header received
0619 02:45:38.626866 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.626867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.626879 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.626939 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:38.627868 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.628351 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.629353 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.629556 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.629634 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.631581 (+ 1947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:38.631582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:38.631582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:38.631590 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:38.632703 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.633090 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.633091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.633092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.633162 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.633400 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.633401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.633401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.633510 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:38.633585 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.633856 (+ 271us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.633935 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:45:38.634203 12869 external_mini_cluster.cc:1428] Setting key ce06e0eb669058f0d18210c6d2dd3b1e
I20260619 02:45:38.634222 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.626053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35073 (local address 127.12.145.67:48337)
0619 02:45:38.626184 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.626230 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.626762 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.627023 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.627027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.627570 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:45:38.627752 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.627757 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.628442 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.628443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.629255 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.629257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.629638 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.629639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.629764 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.630171 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:45:38.630179 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:45:38.631484 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:45:38.632794 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:38.632800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:38.632802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:38.633003 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:38.633229 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:45:38.633230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:45:38.633231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:45:38.633328 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:45:38.633575 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:45:38.633580 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:45:38.633711 (+ 131us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.633834 (+ 123us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.633994 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":61,"threads_started":1}
I20260619 02:45:38.634712 23582 heartbeater.cc:347] Connected to a master server at 127.12.145.126:35073
I20260619 02:45:38.634802 23582 heartbeater.cc:464] Registering TS with master...
I20260619 02:45:38.634969 23582 heartbeater.cc:511] Master 127.12.145.126:35073 requested a full tablet report, sending...
I20260619 02:45:38.635404 23123 ts_manager.cc:194] Registered new tserver with Master: 20087e702fbb49e29e6a9a32efadb204 (127.12.145.67:42763)
I20260619 02:45:38.635771 23123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:48337
I20260619 02:45:38.646023 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:45:38.652860 23162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.647319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38300 (local address 127.12.145.126:35073)
0619 02:45:38.647380 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.647382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.647431 (+ 49us) server_negotiation.cc:407] Connection header received
0619 02:45:38.647481 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.647481 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.647489 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.647538 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:45:38.648087 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.648600 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.649407 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.649593 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.649647 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.650912 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:45:38.650913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:45:38.650913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:45:38.650918 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:45:38.651990 (+ 1072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.652270 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.652270 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.652271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.652316 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:45:38.652451 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:45:38.652451 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:45:38.652451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:45:38.652561 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:45:38.652631 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.652709 (+ 78us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.652762 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:45:38.654280 23123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:45:38.655791 23123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:45:38.661849 23591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.657732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45591 (local address 127.0.0.1:54760)
0619 02:45:38.658204 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.658247 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.658319 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.658505 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.658508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.658510 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:38.658848 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.658850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.660072 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.660072 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.660911 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.660914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.661549 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.661550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.661628 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.661641 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.661735 (+ 94us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.661783 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":47,"threads_started":1}
I20260619 02:45:38.661867 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.657831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54760 (local address 127.12.145.65:45591)
0619 02:45:38.658018 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.658023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.658301 (+ 278us) server_negotiation.cc:407] Connection header received
0619 02:45:38.658383 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.658385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.658397 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.658500 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:38.658931 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.659973 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.660991 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.661457 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.661539 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.661596 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.661753 (+ 157us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.661792 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260619 02:45:38.662197 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.657917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:37271 (local address 127.0.0.1:47462)
0619 02:45:38.658533 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.658541 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.658600 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.658837 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.658837 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.658839 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:38.658869 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.658871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.659694 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.659695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.660829 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.660831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.661770 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.661771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.661828 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.661833 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.661878 (+ 45us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.661915 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"mutex_wait_us":1,"thread_start_us":32,"threads_started":1}
I20260619 02:45:38.662326 23590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.657760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42763 (local address 127.0.0.1:38876)
0619 02:45:38.658394 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.658400 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.658457 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.658705 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.658706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.658707 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:38.658753 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.658754 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.660047 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.660048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.661054 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.661055 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.662052 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.662053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.662111 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.662114 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.662158 (+ 44us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.662191 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":3,"thread_start_us":48,"threads_started":1}
I20260619 02:45:38.662412 23594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.658023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38876 (local address 127.12.145.67:42763)
0619 02:45:38.658161 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.658165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.658458 (+ 293us) server_negotiation.cc:407] Connection header received
0619 02:45:38.658609 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.658611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.658628 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.658707 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:38.658838 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.659942 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.661138 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.661805 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.661863 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.662251 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.662279 (+ 28us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.662321 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260619 02:45:38.662648 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.658044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47462 (local address 127.12.145.66:37271)
0619 02:45:38.658220 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.658225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.658617 (+ 392us) server_negotiation.cc:407] Connection header received
0619 02:45:38.658662 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.658664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.658680 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.658753 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:38.658953 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.659598 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.660920 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.661620 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.661687 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.661736 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.662483 (+ 747us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.662524 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":84,"threads_started":1}
I20260619 02:45:38.662662 23248 tablet_service.cc:1467] Processing CreateTablet for tablet 1b58c1327aae40faa6bfa66a8a19e1a2 (DEFAULT_TABLE table=test-table [id=f61b7c424b464aca8315111bddb06bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:38.663024 23248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b58c1327aae40faa6bfa66a8a19e1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:38.665442 23596 tablet_bootstrap.cc:492] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836: Bootstrap starting.
I20260619 02:45:38.666126 23596 tablet_bootstrap.cc:654] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:38.666020 23516 tablet_service.cc:1467] Processing CreateTablet for tablet 1b58c1327aae40faa6bfa66a8a19e1a2 (DEFAULT_TABLE table=test-table [id=f61b7c424b464aca8315111bddb06bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:38.666342 23516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b58c1327aae40faa6bfa66a8a19e1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:38.666323 23382 tablet_service.cc:1467] Processing CreateTablet for tablet 1b58c1327aae40faa6bfa66a8a19e1a2 (DEFAULT_TABLE table=test-table [id=f61b7c424b464aca8315111bddb06bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:45:38.666640 23382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b58c1327aae40faa6bfa66a8a19e1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:45:38.666769 23596 log.cc:824] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:38.667482 23596 tablet_bootstrap.cc:492] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836: No bootstrap required, opened a new log
I20260619 02:45:38.667560 23596 ts_tablet_manager.cc:1397] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260619 02:45:38.668864 23596 raft_consensus.cc:348] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.669011 23596 raft_consensus.cc:374] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:38.669052 23596 raft_consensus.cc:729] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd3dad68e934a4a995219074fc91836, State: Initialized, Role: FOLLOWER
I20260619 02:45:38.669191 23596 consensus_queue.cc:260] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.669445 23314 heartbeater.cc:503] Master 127.12.145.126:35073 was elected leader, sending a full tablet report...
I20260619 02:45:38.669446 23596 ts_tablet_manager.cc:1428] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 02:45:38.669660 23600 tablet_bootstrap.cc:492] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726: Bootstrap starting.
I20260619 02:45:38.669667 23598 tablet_bootstrap.cc:492] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Bootstrap starting.
I20260619 02:45:38.670251 23600 tablet_bootstrap.cc:654] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:38.670320 23598 tablet_bootstrap.cc:654] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Neither blocks nor log segments found. Creating new log.
I20260619 02:45:38.670826 23600 log.cc:824] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:38.670933 23598 log.cc:824] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Log is configured to *not* fsync() on all Append() calls
I20260619 02:45:38.671476 23600 tablet_bootstrap.cc:492] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726: No bootstrap required, opened a new log
I20260619 02:45:38.671525 23600 ts_tablet_manager.cc:1397] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:45:38.671663 23598 tablet_bootstrap.cc:492] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: No bootstrap required, opened a new log
I20260619 02:45:38.671737 23598 ts_tablet_manager.cc:1397] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:45:38.672737 23600 raft_consensus.cc:348] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.672856 23600 raft_consensus.cc:374] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:38.672876 23600 raft_consensus.cc:729] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d53283c86d9340adbe2d17929db60726, State: Initialized, Role: FOLLOWER
I20260619 02:45:38.672987 23600 consensus_queue.cc:260] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.673039 23598 raft_consensus.cc:348] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.673192 23598 raft_consensus.cc:374] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:45:38.673241 23598 raft_consensus.cc:729] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20087e702fbb49e29e6a9a32efadb204, State: Initialized, Role: FOLLOWER
I20260619 02:45:38.673249 23600 ts_tablet_manager.cc:1428] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:45:38.673355 23448 heartbeater.cc:503] Master 127.12.145.126:35073 was elected leader, sending a full tablet report...
I20260619 02:45:38.673353 23598 consensus_queue.cc:260] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.673632 23582 heartbeater.cc:503] Master 127.12.145.126:35073 was elected leader, sending a full tablet report...
I20260619 02:45:38.673632 23598 ts_tablet_manager.cc:1428] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:45:38.678668 23604 raft_consensus.cc:482] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:45:38.678737 23604 raft_consensus.cc:504] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.679018 23604 leader_election.cc:288] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd3dad68e934a4a995219074fc91836 (127.12.145.65:45591), d53283c86d9340adbe2d17929db60726 (127.12.145.66:37271)
I20260619 02:45:38.681770 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.679349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:52199 (local address 127.12.145.66:37271)
0619 02:45:38.679401 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.679404 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.679524 (+ 120us) server_negotiation.cc:407] Connection header received
0619 02:45:38.679558 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.679559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.679578 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.679638 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:38.679768 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.680190 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.681097 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.681465 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.681517 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.681523 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.681673 (+ 150us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.681713 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:45:38.681784 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.679282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:37271 (local address 127.12.145.67:52199)
0619 02:45:38.679453 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.679462 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.679512 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.679643 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.679644 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.679645 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:38.679700 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.679702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.680295 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.680296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.681008 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.681010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.681537 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.681538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.681604 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.681608 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.681660 (+ 52us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.681687 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":6,"thread_start_us":84,"threads_started":1}
I20260619 02:45:38.681849 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.679270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:54539 (local address 127.12.145.65:45591)
0619 02:45:38.679353 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.679355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.679364 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:45:38.679388 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.679389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.679397 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.679454 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:45:38.679629 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.680134 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.681135 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.681483 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.681567 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.681574 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.681747 (+ 173us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.681781 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 02:45:38.682054 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.679177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45591 (local address 127.12.145.67:54539)
0619 02:45:38.679226 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.679238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:45:38.679282 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:45:38.679469 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:45:38.679470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:45:38.679471 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:45:38.679546 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.679548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.680223 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.680224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.681010 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:45:38.681012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.681579 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.681580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:45:38.681675 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.681679 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:45:38.681731 (+ 52us) client_negotiation.cc:240] Negotiation successful
0619 02:45:38.681765 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":46}
I20260619 02:45:38.682063 23402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b58c1327aae40faa6bfa66a8a19e1a2" candidate_uuid: "20087e702fbb49e29e6a9a32efadb204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d53283c86d9340adbe2d17929db60726" is_pre_election: true
I20260619 02:45:38.682176 23402 raft_consensus.cc:2454] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20087e702fbb49e29e6a9a32efadb204 in term 0.
I20260619 02:45:38.682361 23470 leader_election.cc:302] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20087e702fbb49e29e6a9a32efadb204, d53283c86d9340adbe2d17929db60726; no voters:
I20260619 02:45:38.682348 23268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b58c1327aae40faa6bfa66a8a19e1a2" candidate_uuid: "20087e702fbb49e29e6a9a32efadb204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd3dad68e934a4a995219074fc91836" is_pre_election: true
I20260619 02:45:38.682483 23604 raft_consensus.cc:2781] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:45:38.682504 23268 raft_consensus.cc:2454] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20087e702fbb49e29e6a9a32efadb204 in term 0.
I20260619 02:45:38.682533 23604 raft_consensus.cc:482] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:45:38.682588 23604 raft_consensus.cc:3037] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:38.683326 23604 raft_consensus.cc:504] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.683449 23604 leader_election.cc:288] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd3dad68e934a4a995219074fc91836 (127.12.145.65:45591), d53283c86d9340adbe2d17929db60726 (127.12.145.66:37271)
I20260619 02:45:38.683573 23268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b58c1327aae40faa6bfa66a8a19e1a2" candidate_uuid: "20087e702fbb49e29e6a9a32efadb204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd3dad68e934a4a995219074fc91836"
I20260619 02:45:38.683636 23268 raft_consensus.cc:3037] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:38.683634 23402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b58c1327aae40faa6bfa66a8a19e1a2" candidate_uuid: "20087e702fbb49e29e6a9a32efadb204" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d53283c86d9340adbe2d17929db60726"
I20260619 02:45:38.683694 23402 raft_consensus.cc:3037] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:45:38.684262 23268 raft_consensus.cc:2454] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20087e702fbb49e29e6a9a32efadb204 in term 1.
I20260619 02:45:38.684330 23402 raft_consensus.cc:2454] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20087e702fbb49e29e6a9a32efadb204 in term 1.
I20260619 02:45:38.684458 23470 leader_election.cc:302] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20087e702fbb49e29e6a9a32efadb204, 8dd3dad68e934a4a995219074fc91836; no voters:
I20260619 02:45:38.684551 23604 raft_consensus.cc:2781] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:45:38.684660 23604 raft_consensus.cc:686] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 1 LEADER]: Becoming Leader. State: Replica: 20087e702fbb49e29e6a9a32efadb204, State: Running, Role: LEADER
I20260619 02:45:38.684762 23604 consensus_queue.cc:237] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } }
I20260619 02:45:38.685415 23123 catalog_manager.cc:5495] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20087e702fbb49e29e6a9a32efadb204 (127.12.145.67). New cstate: current_term: 1 leader_uuid: "20087e702fbb49e29e6a9a32efadb204" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20087e702fbb49e29e6a9a32efadb204" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42763 } health_report { overall_health: HEALTHY } } }
I20260619 02:45:38.692654 23594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.690660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38886 (local address 127.12.145.67:42763)
0619 02:45:38.690696 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0619 02:45:38.690698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:45:38.690752 (+ 54us) server_negotiation.cc:407] Connection header received
0619 02:45:38.690806 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:45:38.690807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:45:38.690819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:45:38.690873 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:45:38.690959 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.691393 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.692081 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:45:38.692275 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:45:38.692320 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:45:38.692441 (+ 121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:45:38.692517 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:45:38.692572 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0619 02:45:38.692600 (+ 28us) server_negotiation.cc:299] Negotiation successful
0619 02:45:38.692613 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:45:38.694237 23268 raft_consensus.cc:1261] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 8dd3dad68e934a4a995219074fc91836 [term 1 FOLLOWER]: Refusing update from remote peer 20087e702fbb49e29e6a9a32efadb204: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:38.694499 23402 raft_consensus.cc:1261] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 1 FOLLOWER]: Refusing update from remote peer 20087e702fbb49e29e6a9a32efadb204: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:45:38.694591 23604 consensus_queue.cc:1035] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd3dad68e934a4a995219074fc91836" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:38.694766 23606 consensus_queue.cc:1035] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d53283c86d9340adbe2d17929db60726" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 37271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:45:38.696815 23609 mvcc.cc:205] Tried to move back new op lower bound from 7298404920089223168 to 7298404920053456896. Current Snapshot: MvccSnapshot[applied={T|T < 7298404920089223168}]
I20260619 02:45:38.696959 23611 mvcc.cc:205] Tried to move back new op lower bound from 7298404920089223168 to 7298404920053456896. Current Snapshot: MvccSnapshot[applied={T|T < 7298404920089223168}]
I20260619 02:45:38.699913 23123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:38.700012 23123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:45:38.700735 23123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e13cca47dd314b52a16583363ecea96e: Sending DeleteTablet for 3 replicas of tablet 1b58c1327aae40faa6bfa66a8a19e1a2
I20260619 02:45:38.701046 23516 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b58c1327aae40faa6bfa66a8a19e1a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:38 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:38876
I20260619 02:45:38.701059 23248 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b58c1327aae40faa6bfa66a8a19e1a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:38 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:54760
I20260619 02:45:38.701265 23620 tablet_replica.cc:330] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: stopping tablet replica
I20260619 02:45:38.701274 23382 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b58c1327aae40faa6bfa66a8a19e1a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:45:38 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:47462
I20260619 02:45:38.701355 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 23185
I20260619 02:45:38.701960 23620 raft_consensus.cc:2229] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:45:38.702095 23620 raft_consensus.cc:2258] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:45:38.702520 23620 ts_tablet_manager.cc:1905] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:45:38.704430 23620 ts_tablet_manager.cc:1918] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:45:38.704531 23620 log.cc:1196] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/1b58c1327aae40faa6bfa66a8a19e1a2
I20260619 02:45:38.704798 23620 ts_tablet_manager.cc:1939] T 1b58c1327aae40faa6bfa66a8a19e1a2 P 20087e702fbb49e29e6a9a32efadb204: Deleting consensus metadata
I20260619 02:45:38.705204 23110 catalog_manager.cc:4841] TS 20087e702fbb49e29e6a9a32efadb204 (127.12.145.67:42763): tablet 1b58c1327aae40faa6bfa66a8a19e1a2 (table test-table [id=f61b7c424b464aca8315111bddb06bd3]) successfully deleted
I20260619 02:45:38.706688 23621 tablet_replica.cc:330] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726: stopping tablet replica
I20260619 02:45:38.706818 23621 raft_consensus.cc:2229] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:45:38.706934 23621 raft_consensus.cc:2258] T 1b58c1327aae40faa6bfa66a8a19e1a2 P d53283c86d9340adbe2d17929db60726 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 02:45:38.708395 23108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:45591 (error 108)
W20260619 02:45:38.708889 23590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:45:38.708751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45591 (local address 127.0.0.1:54764)
0619 02:45:38.708811 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.708847 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:45591: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":32}
I20260619 02:45:38.709049 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 23319
W20260619 02:45:38.709793 23108 catalog_manager.cc:4584] TS 8dd3dad68e934a4a995219074fc91836 (127.12.145.65:45591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1b58c1327aae40faa6bfa66a8a19e1a2: Network error: Client connection negotiation failed: client connection to 127.12.145.65:45591: connect: Connection reset by peer (error 104)
I20260619 02:45:38.714236 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 23453
I20260619 02:45:38.714254 23590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:45:38.714154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:37271 (local address 127.0.0.1:47470)
0619 02:45:38.714201 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0619 02:45:38.714222 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.66:37271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260619 02:45:38.718820 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 23091
2026-06-19T02:45:38Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1839 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23625](info): set up 2 sockets
Jun 19 02:45:38 dist-test-slave-fbl4 krb5kdc[23625](info): commencing operation
krb5kdc: starting...
W20260619 02:45:39.774904 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:45:39 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:45:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:45:39Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/rangeradmin_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/rangeradmin_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/rangerlookup_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/rangerlookup_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
I20260619 02:45:39.926777 12869 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskus8Nkk/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/postgres -l logfile start
2026-06-19 02:45:42.242 UTC [23655] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-19 02:45:42.242 UTC [23655] LOG: listening on IPv4 address "127.12.145.84", port 40763
2026-06-19 02:45:42.245 UTC [23655] LOG: listening on Unix socket "/tmp/.s.PGSQL.40763"
2026-06-19 02:45:42.265 UTC [23658] LOG: database system was shut down at 2026-06-19 02:45:40 UTC
2026-06-19 02:45:42.269 UTC [23655] LOG: database system is ready to accept connections
I20260619 02:45:43.278795 12869 mini_postgres.cc:96] Postgres bound to 40763
2026-06-19 02:45:43.284 UTC [23666] FATAL: database "slave" does not exist
127.12.145.84:40763 - accepting connections
I20260619 02:45:43.285228 12869 mini_ranger.cc:161] Starting Ranger...
I20260619 02:45:43.298960 12869 mini_ranger.cc:84] Created miniranger Postgres user
I20260619 02:45:43.722808 12869 mini_ranger.cc:87] Created ranger Postgres database
I20260619 02:45:43.722888 12869 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-admin
2026-06-19 02:45:44,001 [I] DB FLAVOR :POSTGRES
2026-06-19 02:45:44,001 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 02:45:44,002 [I] Checking connection..
2026-06-19 02:45:44,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-19 02:45:44,261 [I] Checking connection passed.
2026-06-19 02:45:44,262 [I] --------- Verifying version history table ---------
2026-06-19 02:45:44,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 02:45:44,512 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 02:45:44,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 02:45:44,766 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 02:45:44,766 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-19 02:45:44,766 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-19 02:45:44.998 UTC [23730] WARNING: there is no transaction in progress
2026-06-19 02:45:45,004 [I] create_dbversion_catalog.sql file imported successfully
2026-06-19 02:45:45,004 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 02:45:45,235 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-19 02:45:45,235 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 02:45:45,235 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-19 02:45:45,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-19 02:45:45,700 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-fbl4.c.gcp-upstream.internal','N') ;"
2026-06-19 02:45:45,937 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 02:45:46,181 [I] Table x_portal_user does not exist in database ranger
2026-06-19 02:45:46,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 02:45:46,433 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-19 02:45:46,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 02:45:46,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 02:45:46,941 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-19 02:45:46,942 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-19 02:45:47.842 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.857 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.871 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.885 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.899 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.915 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.964 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.970 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.983 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:47.993 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:48.002 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:48.016 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:48.025 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:48.031 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:48.037 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:48.044 UTC [23838] WARNING: there is no transaction in progress
2026-06-19 02:45:48,607 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-19 02:45:48,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-19 02:45:48,842 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-19 02:45:48,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 02:45:49,089 [I] Table x_portal_user already exists in database 'ranger'
2026-06-19 02:45:49,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 02:45:49,343 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-19 02:45:49,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 02:45:49,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 02:45:49,851 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-fbl4.c.gcp-upstream.internal';"
2026-06-19 02:45:50,067 [I] CORE_DB_SCHEMA import status has been updated
2026-06-19 02:45:50,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-19 02:45:50,284 [I] DB_PATCHES have already been applied
I20260619 02:45:50.289745 12869 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-admin:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskus8Nkk/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260619 02:45:50.289825 12869 mini_ranger.cc:193] Using host: 127.12.145.84
I20260619 02:45:50.292750 12869 mini_ranger.cc:227] Ranger admin URL: http://127.12.145.84:44235
Jun 19, 2026 2:45:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 2:45:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 2:45:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp
Jun 19, 2026 2:45:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 19, 2026 2:45:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 19, 2026 2:45:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp].
Jun 19, 2026 2:45:51 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260619 02:45:51.398128 12869 mini_ranger.cc:160] Time spent starting Ranger: real 8.113s user 0.000s sys 0.008s
Jun 19, 2026 2:46:11 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 19, 2026 2:46:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 19, 2026 2:46:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 19, 2026 2:46:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 19, 2026 2:46:12 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260619 02:46:12.842763 12869 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/rangerkms_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/rangerkms_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.145.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 19 02:46:12 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837172, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260619 02:46:12.926970 12869 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260619 02:46:12.936618 12869 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260619 02:46:13.756031 12869 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260619 02:46:13.756114 12869 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms
I20260619 02:46:13.756137 12869 mini_ranger_kms.cc:227] Using postgres at 127.12.145.84:40763
2026-06-19 02:46:13,919 [I] DB FLAVOR :POSTGRES
2026-06-19 02:46:13,919 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 02:46:13,919 [I] Checking connection
2026-06-19 02:46:13,919 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-19 02:46:14,147 [I] connection success
2026-06-19 02:46:14,148 [I] --------- Verifying Ranger DB tables ---------
2026-06-19 02:46:14,148 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-19 02:46:14,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-19 02:46:14,376 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-19 02:46:14,376 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 02:46:14,376 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-19 02:46:14,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:40763/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-19 02:46:14,640 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260619 02:46:15.107554 12869 mini_ranger_kms.cc:310] Created kms service
I20260619 02:46:15.291483 12869 mini_ranger_kms.cc:326] Created kudu user
I20260619 02:46:15.336434 12869 mini_ranger_kms.cc:343] Created rangerkms user
Jun 19 02:46:15 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837172, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:46:15.721139 12869 mini_ranger_kms.cc:384] Added ranger policy
I20260619 02:46:15.721247 12869 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms:/tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260619 02:46:15.721267 12869 mini_ranger_kms.cc:240] Using host: 127.12.145.84
I20260619 02:46:15.725387 12869 mini_ranger_kms.cc:276] Ranger KMS PID: 24018
I20260619 02:46:15.725530 12869 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.145.84:57289
Jun 19, 2026 2:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 2:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 2:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 19, 2026 2:46:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 19, 2026 2:46:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-kms/ews/webapp].
Jun 19, 2026 2:46:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260619 02:46:17.982692 12869 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.056s user 0.000s sys 0.147s
I20260619 02:46:17.982802 12869 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260619 02:46:17.982913 12869 mini_ranger_kms.cc:401] 127.12.145.84:57289/kms/v1/keys
Jun 19 02:46:18 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781837178, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 19 02:46:18 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837178, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.84@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
Jun 19 02:46:18 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837178, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.84@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
Jun 19 02:46:20 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:46:20.987272 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:42067
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:42067
--ranger_config_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:57289/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:46:21.065990 24069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:46:21.066222 24069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:46:21.066258 24069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:46:21.067402 24069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:46:21.067472 24069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:46:21.067497 24069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:46:21.067523 24069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:46:21.067554 24069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:46:21.069041 24069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.145.84:57289/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:42067
--ranger_config_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:42067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:46:21.069299 24069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:46:21.069527 24069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:46:21.075259 24077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:46:21.075244 24075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:46:21.075282 24074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:46:21.075593 24069 server_base.cc:1034] running on GCE node
I20260619 02:46:21.075842 24069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:46:21.076205 24069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:46:21.077394 24069 hybrid_clock.cc:648] HybridClock initialized: now 1781837181077379 us; error 27 us; skew 500 ppm
Jun 19 02:46:21 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837181, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:46:21.087172 24069 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:46:21.087699 24069 webserver.cc:460] Webserver started at http://127.12.145.126:35927/ using document root <none> and password file <none>
I20260619 02:46:21.087931 24069 fs_manager.cc:359] Metadata directory not provided
I20260619 02:46:21.087989 24069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:46:21.088130 24069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:46:21 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837181, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:46:21.145627 24069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "b5df613a29144c2f895c938d68b76ed6"
format_stamp: "Formatted at 2026-06-19 02:46:21 on dist-test-slave-fbl4"
server_key: "19e22eca96637715f9fb0a34bec16f22"
server_key_iv: "c6616a6c3bb429f8867cd46d9dc1aae8"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:21.146035 24069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "b5df613a29144c2f895c938d68b76ed6"
format_stamp: "Formatted at 2026-06-19 02:46:21 on dist-test-slave-fbl4"
server_key: "19e22eca96637715f9fb0a34bec16f22"
server_key_iv: "c6616a6c3bb429f8867cd46d9dc1aae8"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:21.147552 24069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260619 02:46:21.158576 24084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:21.158926 24069 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:46:21.159099 24069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "b5df613a29144c2f895c938d68b76ed6"
format_stamp: "Formatted at 2026-06-19 02:46:21 on dist-test-slave-fbl4"
server_key: "19e22eca96637715f9fb0a34bec16f22"
server_key_iv: "c6616a6c3bb429f8867cd46d9dc1aae8"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:21.159314 24069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:46:21.188932 24069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:46:21.190991 24069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:46:21.191134 24069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:46:21.196003 24069 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:42067
I20260619 02:46:21.196028 24136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:42067 every 8 connection(s)
I20260619 02:46:21.196425 24069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:46:21.197104 24137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:46:21.199404 24137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6: Bootstrap starting.
I20260619 02:46:21.199950 24137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6: Neither blocks nor log segments found. Creating new log.
I20260619 02:46:21.200222 24137 log.cc:824] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6: Log is configured to *not* fsync() on all Append() calls
I20260619 02:46:21.200871 24137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6: No bootstrap required, opened a new log
I20260619 02:46:21.202901 24137 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5df613a29144c2f895c938d68b76ed6" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42067 } }
I20260619 02:46:21.203097 24137 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:46:21.203137 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 24069
I20260619 02:46:21.203177 24137 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5df613a29144c2f895c938d68b76ed6, State: Initialized, Role: FOLLOWER
I20260619 02:46:21.203235 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:46:21.203374 24137 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5df613a29144c2f895c938d68b76ed6" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42067 } }
I20260619 02:46:21.203424 12869 external_mini_cluster.cc:1428] Setting key 33c804e0bc495d3fd3d1201e94eb4508
I20260619 02:46:21.203460 24137 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:46:21.203493 24137 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:46:21.203562 24137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:46:21.204267 24137 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5df613a29144c2f895c938d68b76ed6" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42067 } }
I20260619 02:46:21.204381 24137 leader_election.cc:302] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5df613a29144c2f895c938d68b76ed6; no voters:
I20260619 02:46:21.204622 24137 leader_election.cc:288] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:46:21.204644 24142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:46:21.204882 24142 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [term 1 LEADER]: Becoming Leader. State: Replica: b5df613a29144c2f895c938d68b76ed6, State: Running, Role: LEADER
I20260619 02:46:21.204949 24137 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:46:21.205005 24142 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5df613a29144c2f895c938d68b76ed6" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42067 } }
I20260619 02:46:21.206907 24144 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5df613a29144c2f895c938d68b76ed6. Latest consensus state: current_term: 1 leader_uuid: "b5df613a29144c2f895c938d68b76ed6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5df613a29144c2f895c938d68b76ed6" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42067 } } }
I20260619 02:46:21.206986 24144 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [sys.catalog]: This master's current role is: LEADER
I20260619 02:46:21.207427 24137 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 02:46:21.207432 24143 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5df613a29144c2f895c938d68b76ed6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5df613a29144c2f895c938d68b76ed6" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42067 } } }
I20260619 02:46:21.207880 24143 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6 [sys.catalog]: This master's current role is: LEADER
I20260619 02:46:21.207497 24156 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:46:21.212410 24156 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 19 02:46:21 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:46:21.214166 24156 catalog_manager.cc:1347] Generated new cluster ID: 224a03d9f25742efbc48303bd0c692b4
I20260619 02:46:21.214210 24156 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:46:21.217384 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:21.203891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38798 (local address 127.12.145.126:42067)
0619 02:46:21.204080 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:21.204089 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:21.204120 (+ 31us) server_negotiation.cc:407] Connection header received
0619 02:46:21.204230 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:21.204237 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:21.204293 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:21.204445 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:46:21.205145 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:21.206532 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:21.207566 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:21.210637 (+ 3071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:21.210814 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:21.213546 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:46:21.213550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:46:21.213550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:46:21.213561 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:46:21.215767 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:21.216130 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:21.216133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:21.216133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:21.216224 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:21.216482 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:21.216483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:21.216483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:21.216749 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:46:21.216875 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:21.217000 (+ 125us) server_negotiation.cc:299] Negotiation successful
0619 02:46:21.217114 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":74,"threads_started":1}
I20260619 02:46:21.221441 24156 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:46:21.222114 24156 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:46:21.231518 24156 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6: Generated new TSK 0
I20260619 02:46:21.231722 24156 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:46:21.934475 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:57289/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42067
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:46:22.047751 24182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:46:22.048028 24182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:46:22.048064 24182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:46:22.049934 24182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:46:22.050006 24182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:46:22.050050 24182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:46:22.052376 24182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.145.84:57289/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:46:22.052632 24182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:46:22.052933 24182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:46:22.059124 24188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:46:22.059211 24187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:46:22.059485 24190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:46:22.059978 24182 server_base.cc:1034] running on GCE node
I20260619 02:46:22.060277 24182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:46:22.060554 24182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:46:22.061757 24182 hybrid_clock.cc:648] HybridClock initialized: now 1781837182061735 us; error 33 us; skew 500 ppm
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:46:22.065183 24182 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:46:22.065729 24182 webserver.cc:460] Webserver started at http://127.12.145.65:42203/ using document root <none> and password file <none>
I20260619 02:46:22.066044 24182 fs_manager.cc:359] Metadata directory not provided
I20260619 02:46:22.066115 24182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:46:22.066256 24182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:46:22.082677 24182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "8be5fa2dcdbb428ca4fff65b5acc3570"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "9acff201076475edf9827e4db503692d"
server_key_iv: "175be50574799d915f1d8c99da35eb3f"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.083129 24182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "8be5fa2dcdbb428ca4fff65b5acc3570"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "9acff201076475edf9827e4db503692d"
server_key_iv: "175be50574799d915f1d8c99da35eb3f"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.090945 24182 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.000s
I20260619 02:46:22.103950 24199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.104126 24182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:46:22.104212 24182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "8be5fa2dcdbb428ca4fff65b5acc3570"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "9acff201076475edf9827e4db503692d"
server_key_iv: "175be50574799d915f1d8c99da35eb3f"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.104308 24182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:46:22.123512 24182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:46:22.126226 24182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:46:22.126416 24182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:46:22.126696 24182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:46:22.127115 24182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:46:22.127218 24182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.127317 24182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:46:22.127388 24182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.133502 24182 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:36521
I20260619 02:46:22.133805 24312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:36521 every 8 connection(s)
I20260619 02:46:22.134008 24182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:46:22.136914 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 24182
I20260619 02:46:22.137020 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:46:22.137217 12869 external_mini_cluster.cc:1428] Setting key b0e5d82b2d4e5fc7d3a854679f294307
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:46:22.159564 24315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.136706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:42067 (local address 127.12.145.65:59417)
0619 02:46:22.139656 (+ 2950us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.139719 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.140350 (+ 631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.140802 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.140806 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.141047 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:46:22.141318 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.141324 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.142354 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.142355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.143639 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.143642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.144200 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.144201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.144388 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.145135 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:46:22.145146 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:46:22.155558 (+ 10412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:46:22.157812 (+ 2254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:46:22.157822 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:46:22.157825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:46:22.158144 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:46:22.158367 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:46:22.158368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:46:22.158368 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:46:22.158515 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:46:22.158860 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:46:22.158865 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:46:22.159044 (+ 179us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.159147 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.159318 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2902,"thread_start_us":92,"threads_started":1}
I20260619 02:46:22.159930 24316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.136993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:59417 (local address 127.12.145.126:42067)
0619 02:46:22.140533 (+ 3540us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.140536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.140543 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:46:22.140564 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.140565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.140576 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.140659 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:46:22.141434 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.142250 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.143749 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.144053 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.144114 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.155732 (+ 11618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:46:22.155734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:46:22.155735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:46:22.155744 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:46:22.157688 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.158228 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.158229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.158229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.158298 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.158617 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.158618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.158618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.158774 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:46:22.158834 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.159739 (+ 905us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.159829 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3510,"thread_start_us":69,"threads_started":1}
I20260619 02:46:22.160429 24313 heartbeater.cc:347] Connected to a master server at 127.12.145.126:42067
I20260619 02:46:22.160558 24313 heartbeater.cc:464] Registering TS with master...
I20260619 02:46:22.160753 24313 heartbeater.cc:511] Master 127.12.145.126:42067 requested a full tablet report, sending...
I20260619 02:46:22.161303 24101 ts_manager.cc:194] Registered new tserver with Master: 8be5fa2dcdbb428ca4fff65b5acc3570 (127.12.145.65:36521)
I20260619 02:46:22.162174 24101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:59417
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:46:22.192104 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:57289/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42067
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260619 02:46:22.310741 24321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:46:22.311012 24321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:46:22.311046 24321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:46:22.312678 24321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:46:22.312733 24321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:46:22.312773 24321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:46:22.314927 24321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.145.84:57289/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:46:22.315157 24321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:46:22.315408 24321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:46:22.321645 24330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:46:22.322235 24328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:46:22.322736 24327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:46:22.322898 24321 server_base.cc:1034] running on GCE node
I20260619 02:46:22.323088 24321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:46:22.323360 24321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:46:22.324551 24321 hybrid_clock.cc:648] HybridClock initialized: now 1781837182324521 us; error 42 us; skew 500 ppm
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:46:22.327755 24321 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:46:22.328302 24321 webserver.cc:460] Webserver started at http://127.12.145.66:36509/ using document root <none> and password file <none>
I20260619 02:46:22.328572 24321 fs_manager.cc:359] Metadata directory not provided
I20260619 02:46:22.328629 24321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:46:22.328763 24321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:46:22.342337 24321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "66355a748de84f1396fc2b65c060c60c"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "fd7d318651782a17bddf887714db2ead"
server_key_iv: "9a95e077109f866c7c4edfa7da25577d"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.342905 24321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "66355a748de84f1396fc2b65c060c60c"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "fd7d318651782a17bddf887714db2ead"
server_key_iv: "9a95e077109f866c7c4edfa7da25577d"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.347004 24321 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260619 02:46:22.360080 24337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.360282 24321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:46:22.360378 24321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "66355a748de84f1396fc2b65c060c60c"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "fd7d318651782a17bddf887714db2ead"
server_key_iv: "9a95e077109f866c7c4edfa7da25577d"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.360478 24321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:46:22.378690 24321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:46:22.381078 24321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:46:22.381227 24321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:46:22.381450 24321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:46:22.381780 24321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:46:22.381836 24321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.381875 24321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:46:22.381901 24321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.389446 24321 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:35713
I20260619 02:46:22.389846 24321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:46:22.391765 24450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:35713 every 8 connection(s)
I20260619 02:46:22.392666 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 24321
I20260619 02:46:22.392782 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:46:22.392975 12869 external_mini_cluster.cc:1428] Setting key d7571bac7b52003d97f5a25d3ef10487
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
I20260619 02:46:22.403064 24316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.391634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:39077 (local address 127.12.145.126:42067)
0619 02:46:22.391681 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.391683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.392220 (+ 537us) server_negotiation.cc:407] Connection header received
0619 02:46:22.393005 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.393007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.393026 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.393060 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:46:22.393997 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.394799 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.396385 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.396717 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.396762 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.399479 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:46:22.399481 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:46:22.399481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:46:22.399489 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:46:22.401282 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.401795 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.401797 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.401797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.401857 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.402162 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.402163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.402163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.402336 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:46:22.402408 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.402919 (+ 511us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.403000 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260619 02:46:22.403515 24453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.391361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:42067 (local address 127.12.145.66:39077)
0619 02:46:22.392073 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.392113 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.392869 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.393270 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.393274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.393572 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:46:22.393888 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.393895 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.394914 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.394914 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.396280 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.396283 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.396850 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.396851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.396999 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.397625 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:46:22.397635 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:46:22.399376 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:46:22.401381 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:46:22.401388 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:46:22.401390 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:46:22.401702 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:46:22.401934 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:46:22.401935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:46:22.401935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:46:22.402079 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:46:22.402414 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:46:22.402421 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:46:22.402616 (+ 195us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.402743 (+ 127us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.402920 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":76,"threads_started":1}
I20260619 02:46:22.404058 24451 heartbeater.cc:347] Connected to a master server at 127.12.145.126:42067
I20260619 02:46:22.404179 24451 heartbeater.cc:464] Registering TS with master...
I20260619 02:46:22.404366 24451 heartbeater.cc:511] Master 127.12.145.126:42067 requested a full tablet report, sending...
I20260619 02:46:22.404819 24101 ts_manager.cc:194] Registered new tserver with Master: 66355a748de84f1396fc2b65c060c60c (127.12.145.66:35713)
I20260619 02:46:22.405252 24101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:39077
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:46:22.421921 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:57289/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42067
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:46:22.534878 24456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:46:22.535180 24456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:46:22.535223 24456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:46:22.536375 24456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:46:22.536439 24456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:46:22.536484 24456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:46:22.538444 24456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.145.84:57289/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:46:22.538712 24456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:46:22.538926 24456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:46:22.544317 24464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:46:22.544569 24456 server_base.cc:1034] running on GCE node
W20260619 02:46:22.544764 24462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:46:22.544945 24461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:46:22.545179 24456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:46:22.545428 24456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:46:22.548684 24456 hybrid_clock.cc:648] HybridClock initialized: now 1781837182548661 us; error 37 us; skew 500 ppm
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:46:22.551210 24456 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:46:22.551677 24456 webserver.cc:460] Webserver started at http://127.12.145.67:42553/ using document root <none> and password file <none>
I20260619 02:46:22.551921 24456 fs_manager.cc:359] Metadata directory not provided
I20260619 02:46:22.551990 24456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:46:22.552127 24456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:46:22.573410 24456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "8073c342d4ce45ee9db54853754cff5d"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "3c70442230ab808e41f78f77fa05ff0c"
server_key_iv: "cac96406d1db349dad73bf5d3f71901b"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.573879 24456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "8073c342d4ce45ee9db54853754cff5d"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "3c70442230ab808e41f78f77fa05ff0c"
server_key_iv: "cac96406d1db349dad73bf5d3f71901b"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.579982 24456 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.000s
I20260619 02:46:22.601087 24471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.601289 24456 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.000s sys 0.000s
I20260619 02:46:22.601383 24456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "8073c342d4ce45ee9db54853754cff5d"
format_stamp: "Formatted at 2026-06-19 02:46:22 on dist-test-slave-fbl4"
server_key: "3c70442230ab808e41f78f77fa05ff0c"
server_key_iv: "cac96406d1db349dad73bf5d3f71901b"
server_key_version: "kuduclusterkey@0"
I20260619 02:46:22.601482 24456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:46:22.625979 24456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:46:22.631457 24456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:46:22.631666 24456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:46:22.631937 24456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:46:22.632300 24456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:46:22.632380 24456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.632448 24456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:46:22.632503 24456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:46:22.638767 24456 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:46797
I20260619 02:46:22.639038 24584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:46797 every 8 connection(s)
I20260619 02:46:22.639257 24456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:46:22.639773 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 24456
I20260619 02:46:22.639868 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:46:22.640028 12869 external_mini_cluster.cc:1428] Setting key 165a6e081a81aaa46bdda55dd02fd526
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:46:22.652236 24316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.642097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:36945 (local address 127.12.145.126:42067)
0619 02:46:22.642139 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.642142 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.642710 (+ 568us) server_negotiation.cc:407] Connection header received
0619 02:46:22.643293 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.643294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.643306 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.643335 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:46:22.644088 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.644838 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.646250 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.646574 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.646648 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.649027 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:46:22.649028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:46:22.649029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:46:22.649036 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:46:22.650653 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.651153 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.651154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.651154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.651213 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.651504 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.651505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.651505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.651638 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:46:22.651680 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.652057 (+ 377us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.652137 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:46:22.652853 24587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.641858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:42067 (local address 127.12.145.67:36945)
0619 02:46:22.642571 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.642617 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.643183 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.643505 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.643509 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.643735 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:46:22.643988 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.643993 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.644941 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.644942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.646147 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.646150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.646655 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.646656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.646795 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.647339 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:46:22.647348 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:46:22.648923 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:46:22.650746 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:46:22.650752 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:46:22.650755 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:46:22.651060 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:46:22.651288 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:46:22.651289 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:46:22.651289 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:46:22.651419 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:46:22.651726 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:46:22.651732 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:46:22.651897 (+ 165us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.652344 (+ 447us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.652519 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":77,"threads_started":1}
I20260619 02:46:22.653548 24585 heartbeater.cc:347] Connected to a master server at 127.12.145.126:42067
I20260619 02:46:22.653644 24585 heartbeater.cc:464] Registering TS with master...
I20260619 02:46:22.653848 24585 heartbeater.cc:511] Master 127.12.145.126:42067 requested a full tablet report, sending...
I20260619 02:46:22.654307 24100 ts_manager.cc:194] Registered new tserver with Master: 8073c342d4ce45ee9db54853754cff5d (127.12.145.67:46797)
I20260619 02:46:22.654771 24100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:36945
I20260619 02:46:22.665150 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:46:22.679407 24316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.666906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38806 (local address 127.12.145.126:42067)
0619 02:46:22.666945 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.666947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.669959 (+ 3012us) server_negotiation.cc:407] Connection header received
0619 02:46:22.670038 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.670039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.670050 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.670095 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:46:22.670724 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.671232 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.671978 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.672184 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.672270 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.673973 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:46:22.673975 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:46:22.673975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:46:22.673983 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:46:22.677105 (+ 3122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.678499 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.678500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.678501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.678579 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:46:22.678797 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:46:22.678798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:46:22.678799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:46:22.678927 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:46:22.679002 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.679226 (+ 224us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.679303 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:46:22.686045 24100 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:46:22.688488 24100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Jun 19 02:46:22 dist-test-slave-fbl4 krb5kdc[23625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837182, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:46:22.728497 24599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.721316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:35713 (local address 127.0.0.1:58134)
0619 02:46:22.722406 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.722453 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.722522 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.723236 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.723239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.723242 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:46:22.723311 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.723313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.725292 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.725293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.726608 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.726610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.728189 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.728190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.728269 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.728285 (+ 16us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.728351 (+ 66us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.728403 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"thread_start_us":103,"threads_started":1}
I20260619 02:46:22.730484 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.721842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58134 (local address 127.12.145.66:35713)
0619 02:46:22.722339 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.722343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.722503 (+ 160us) server_negotiation.cc:407] Connection header received
0619 02:46:22.723049 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.723051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.723064 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.723151 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:46:22.723759 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.724915 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.726997 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.727727 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.727795 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.727886 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.730349 (+ 2463us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.730392 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":92,"threads_started":1}
I20260619 02:46:22.731513 24602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.722026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38024 (local address 127.12.145.67:46797)
0619 02:46:22.722203 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.722209 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.722923 (+ 714us) server_negotiation.cc:407] Connection header received
0619 02:46:22.722970 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.722973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.722990 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.723445 (+ 455us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:46:22.724184 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.725198 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.729401 (+ 4203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.730211 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.730286 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.730518 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.731393 (+ 875us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.731434 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":101,"threads_started":1}
I20260619 02:46:22.731312 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.721561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:46797 (local address 127.0.0.1:38024)
0619 02:46:22.722825 (+ 1264us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.722833 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.722870 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.724066 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.724067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.724069 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:46:22.724109 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.724111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.725666 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.725667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.729274 (+ 3607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.729277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.731112 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.731113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.731162 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.731165 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.731204 (+ 39us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.731239 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1252,"thread_start_us":67,"threads_started":1}
I20260619 02:46:22.732770 24385 tablet_service.cc:1467] Processing CreateTablet for tablet dd3073af641d487c80887005c2492de8 (DEFAULT_TABLE table=test-table [id=75356cc8fe9b422dad55e5cca4000d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:46:22.733121 24385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd3073af641d487c80887005c2492de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:46:22.733152 24514 tablet_service.cc:1467] Processing CreateTablet for tablet dd3073af641d487c80887005c2492de8 (DEFAULT_TABLE table=test-table [id=75356cc8fe9b422dad55e5cca4000d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:46:22.733345 24597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.721316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:36521 (local address 127.0.0.1:39630)
0619 02:46:22.722696 (+ 1380us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.722705 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.722753 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.725564 (+ 2811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.725565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.725567 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:46:22.725600 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.725601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.727890 (+ 2289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.727891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.731020 (+ 3129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.731023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.733113 (+ 2090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.733114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.733175 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.733179 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.733227 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.733262 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1364,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260619 02:46:22.733498 24514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd3073af641d487c80887005c2492de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:46:22.733616 24600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.721603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39630 (local address 127.12.145.65:36521)
0619 02:46:22.722644 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.722648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.723523 (+ 875us) server_negotiation.cc:407] Connection header received
0619 02:46:22.723561 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.723564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.723581 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.725501 (+ 1920us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:46:22.726167 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.727803 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.731770 (+ 3967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.732966 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.733032 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.733080 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.733508 (+ 428us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.733553 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1009,"thread_start_us":64,"threads_started":1}
I20260619 02:46:22.734174 24247 tablet_service.cc:1467] Processing CreateTablet for tablet dd3073af641d487c80887005c2492de8 (DEFAULT_TABLE table=test-table [id=75356cc8fe9b422dad55e5cca4000d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:46:22.734463 24247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd3073af641d487c80887005c2492de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:46:22.737752 24604 tablet_bootstrap.cc:492] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Bootstrap starting.
I20260619 02:46:22.737941 24605 tablet_bootstrap.cc:492] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570: Bootstrap starting.
I20260619 02:46:22.740106 24605 tablet_bootstrap.cc:654] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570: Neither blocks nor log segments found. Creating new log.
I20260619 02:46:22.739907 24604 tablet_bootstrap.cc:654] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Neither blocks nor log segments found. Creating new log.
I20260619 02:46:22.740702 24604 log.cc:824] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Log is configured to *not* fsync() on all Append() calls
I20260619 02:46:22.742765 24605 log.cc:824] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570: Log is configured to *not* fsync() on all Append() calls
I20260619 02:46:22.744248 24604 tablet_bootstrap.cc:492] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: No bootstrap required, opened a new log
I20260619 02:46:22.744349 24604 ts_tablet_manager.cc:1397] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260619 02:46:22.747082 24603 tablet_bootstrap.cc:492] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Bootstrap starting.
I20260619 02:46:22.748080 24603 tablet_bootstrap.cc:654] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Neither blocks nor log segments found. Creating new log.
I20260619 02:46:22.748371 24603 log.cc:824] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Log is configured to *not* fsync() on all Append() calls
I20260619 02:46:22.749153 24603 tablet_bootstrap.cc:492] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: No bootstrap required, opened a new log
I20260619 02:46:22.749218 24603 ts_tablet_manager.cc:1397] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:46:22.751084 24605 tablet_bootstrap.cc:492] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570: No bootstrap required, opened a new log
I20260619 02:46:22.751153 24605 ts_tablet_manager.cc:1397] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260619 02:46:22.751200 24603 raft_consensus.cc:348] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.751366 24603 raft_consensus.cc:374] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:46:22.751401 24603 raft_consensus.cc:729] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66355a748de84f1396fc2b65c060c60c, State: Initialized, Role: FOLLOWER
I20260619 02:46:22.751573 24603 consensus_queue.cc:260] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.751879 24603 ts_tablet_manager.cc:1428] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:46:22.753587 24605 raft_consensus.cc:348] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.753772 24605 raft_consensus.cc:374] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:46:22.753811 24605 raft_consensus.cc:729] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be5fa2dcdbb428ca4fff65b5acc3570, State: Initialized, Role: FOLLOWER
I20260619 02:46:22.754032 24605 consensus_queue.cc:260] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.754309 24605 ts_tablet_manager.cc:1428] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:46:22.754496 24313 heartbeater.cc:503] Master 127.12.145.126:42067 was elected leader, sending a full tablet report...
I20260619 02:46:22.754983 24451 heartbeater.cc:503] Master 127.12.145.126:42067 was elected leader, sending a full tablet report...
I20260619 02:46:22.759238 24604 raft_consensus.cc:348] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.759428 24604 raft_consensus.cc:374] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:46:22.759473 24604 raft_consensus.cc:729] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8073c342d4ce45ee9db54853754cff5d, State: Initialized, Role: FOLLOWER
I20260619 02:46:22.759639 24604 consensus_queue.cc:260] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.759917 24604 ts_tablet_manager.cc:1428] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260619 02:46:22.760066 24585 heartbeater.cc:503] Master 127.12.145.126:42067 was elected leader, sending a full tablet report...
I20260619 02:46:22.772244 24610 raft_consensus.cc:482] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:46:22.772400 24610 raft_consensus.cc:504] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.772751 24610 leader_election.cc:288] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66355a748de84f1396fc2b65c060c60c (127.12.145.66:35713), 8073c342d4ce45ee9db54853754cff5d (127.12.145.67:46797)
I20260619 02:46:22.779919 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.773406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:40653 (local address 127.12.145.66:35713)
0619 02:46:22.773444 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.773445 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.773598 (+ 153us) server_negotiation.cc:407] Connection header received
0619 02:46:22.773719 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.773720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.773732 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.773764 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:46:22.774040 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.774837 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.778677 (+ 3840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.779243 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.779295 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.779303 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.779794 (+ 491us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.779836 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:46:22.780171 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.772969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:35713 (local address 127.12.145.65:40653)
0619 02:46:22.773533 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.773545 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.773625 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.773837 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.773837 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.773852 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:46:22.773945 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.773948 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.774961 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.774961 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.776165 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.776168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.779644 (+ 3476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.779645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.779714 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.779718 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.780055 (+ 337us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.780096 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":91,"threads_started":1}
I20260619 02:46:22.780614 24405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3073af641d487c80887005c2492de8" candidate_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66355a748de84f1396fc2b65c060c60c" is_pre_election: true
I20260619 02:46:22.780769 24405 raft_consensus.cc:2454] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8be5fa2dcdbb428ca4fff65b5acc3570 in term 0.
I20260619 02:46:22.781441 24203 leader_election.cc:302] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66355a748de84f1396fc2b65c060c60c, 8be5fa2dcdbb428ca4fff65b5acc3570; no voters:
I20260619 02:46:22.781575 24610 raft_consensus.cc:2781] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:46:22.781617 24610 raft_consensus.cc:482] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:46:22.781639 24610 raft_consensus.cc:3037] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:46:22.782533 24610 raft_consensus.cc:504] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.782807 24610 leader_election.cc:288] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [CANDIDATE]: Term 1 election: Requested vote from peers 66355a748de84f1396fc2b65c060c60c (127.12.145.66:35713), 8073c342d4ce45ee9db54853754cff5d (127.12.145.67:46797)
I20260619 02:46:22.783171 24405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3073af641d487c80887005c2492de8" candidate_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66355a748de84f1396fc2b65c060c60c"
I20260619 02:46:22.783252 24405 raft_consensus.cc:3037] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:46:22.784152 24405 raft_consensus.cc:2454] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8be5fa2dcdbb428ca4fff65b5acc3570 in term 1.
I20260619 02:46:22.784369 24203 leader_election.cc:302] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66355a748de84f1396fc2b65c060c60c, 8be5fa2dcdbb428ca4fff65b5acc3570; no voters:
I20260619 02:46:22.784488 24610 raft_consensus.cc:2781] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:46:22.784754 24610 raft_consensus.cc:686] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [term 1 LEADER]: Becoming Leader. State: Replica: 8be5fa2dcdbb428ca4fff65b5acc3570, State: Running, Role: LEADER
I20260619 02:46:22.784852 24610 consensus_queue.cc:237] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } }
I20260619 02:46:22.785777 24101 catalog_manager.cc:5495] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8be5fa2dcdbb428ca4fff65b5acc3570 (127.12.145.65). New cstate: current_term: 1 leader_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 36521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 } health_report { overall_health: UNKNOWN } } }
I20260619 02:46:22.787225 24602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.773325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:56731 (local address 127.12.145.67:46797)
0619 02:46:22.773367 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.773369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.776336 (+ 2967us) server_negotiation.cc:407] Connection header received
0619 02:46:22.776429 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.776430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.776438 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.776465 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:46:22.776662 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.777346 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.780555 (+ 3209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.781133 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.781188 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.781195 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.787099 (+ 5904us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.787154 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:46:22.787684 24612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.773146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:46797 (local address 127.12.145.65:56731)
0619 02:46:22.776282 (+ 3136us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.776291 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:46:22.776360 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:46:22.776522 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:46:22.776522 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:46:22.776524 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:46:22.776585 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.776586 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.777465 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.777466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.778555 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:46:22.778558 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.786936 (+ 8378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.786937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:46:22.787011 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.787015 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:46:22.787547 (+ 532us) client_negotiation.cc:240] Negotiation successful
0619 02:46:22.787592 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3118,"thread_start_us":48,"threads_started":1}
I20260619 02:46:22.788120 24531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3073af641d487c80887005c2492de8" candidate_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8073c342d4ce45ee9db54853754cff5d" is_pre_election: true
I20260619 02:46:22.788275 24531 raft_consensus.cc:2454] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8be5fa2dcdbb428ca4fff65b5acc3570 in term 0.
I20260619 02:46:22.788127 24530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd3073af641d487c80887005c2492de8" candidate_uuid: "8be5fa2dcdbb428ca4fff65b5acc3570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8073c342d4ce45ee9db54853754cff5d"
I20260619 02:46:22.788406 24530 raft_consensus.cc:3037] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:46:22.789186 24530 raft_consensus.cc:2454] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8be5fa2dcdbb428ca4fff65b5acc3570 in term 1.
I20260619 02:46:22.799716 24600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.796315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39646 (local address 127.12.145.65:36521)
0619 02:46:22.796349 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:46:22.796351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:46:22.796369 (+ 18us) server_negotiation.cc:407] Connection header received
0619 02:46:22.796511 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:46:22.796512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:46:22.796531 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:46:22.796596 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:46:22.796780 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.797524 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.798650 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:46:22.798942 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:46:22.799001 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:46:22.799192 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:46:22.799308 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:46:22.799394 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 02:46:22.799610 (+ 216us) server_negotiation.cc:299] Negotiation successful
0619 02:46:22.799631 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:46:22.801514 24405 raft_consensus.cc:1261] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 1 FOLLOWER]: Refusing update from remote peer 8be5fa2dcdbb428ca4fff65b5acc3570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:46:22.801926 24614 consensus_queue.cc:1035] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66355a748de84f1396fc2b65c060c60c" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 35713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:46:22.801990 24530 raft_consensus.cc:1261] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 1 FOLLOWER]: Refusing update from remote peer 8be5fa2dcdbb428ca4fff65b5acc3570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:46:22.802234 24614 consensus_queue.cc:1035] T dd3073af641d487c80887005c2492de8 P 8be5fa2dcdbb428ca4fff65b5acc3570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8073c342d4ce45ee9db54853754cff5d" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 46797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:46:22.807248 24617 mvcc.cc:205] Tried to move back new op lower bound from 7298405100752465920 to 7298405100687425536. Current Snapshot: MvccSnapshot[applied={T|T < 7298405100752465920}]
I20260619 02:46:22.807726 24620 mvcc.cc:205] Tried to move back new op lower bound from 7298405100752465920 to 7298405100687425536. Current Snapshot: MvccSnapshot[applied={T|T < 7298405100752465920}]
I20260619 02:46:22.809926 24618 mvcc.cc:205] Tried to move back new op lower bound from 7298405100752465920 to 7298405100687425536. Current Snapshot: MvccSnapshot[applied={T|T < 7298405100752465920}]
I20260619 02:46:22.812139 24101 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:46:22.812220 24101 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:46:22.813057 24101 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b5df613a29144c2f895c938d68b76ed6: Sending DeleteTablet for 3 replicas of tablet dd3073af641d487c80887005c2492de8
I20260619 02:46:22.813436 24247 tablet_service.cc:1514] Processing DeleteTablet for tablet dd3073af641d487c80887005c2492de8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:46:22 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:39630
I20260619 02:46:22.813557 24385 tablet_service.cc:1514] Processing DeleteTablet for tablet dd3073af641d487c80887005c2492de8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:46:22 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:58134
I20260619 02:46:22.813572 24514 tablet_service.cc:1514] Processing DeleteTablet for tablet dd3073af641d487c80887005c2492de8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:46:22 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:38024
I20260619 02:46:22.813995 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 24182
I20260619 02:46:22.816222 24628 tablet_replica.cc:330] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: stopping tablet replica
I20260619 02:46:22.816393 24628 raft_consensus.cc:2229] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:46:22.816570 24628 raft_consensus.cc:2258] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:46:22.817085 24628 ts_tablet_manager.cc:1905] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:46:22.817255 24627 tablet_replica.cc:330] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: stopping tablet replica
I20260619 02:46:22.817399 24627 raft_consensus.cc:2229] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:46:22.817551 24627 raft_consensus.cc:2258] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:46:22.818027 24627 ts_tablet_manager.cc:1905] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:46:22.818893 24628 ts_tablet_manager.cc:1918] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:46:22.818966 24628 log.cc:1196] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/dd3073af641d487c80887005c2492de8
I20260619 02:46:22.819520 24628 ts_tablet_manager.cc:1939] T dd3073af641d487c80887005c2492de8 P 8073c342d4ce45ee9db54853754cff5d: Deleting consensus metadata
I20260619 02:46:22.819904 24088 catalog_manager.cc:4841] TS 8073c342d4ce45ee9db54853754cff5d (127.12.145.67:46797): tablet dd3073af641d487c80887005c2492de8 (table test-table [id=75356cc8fe9b422dad55e5cca4000d42]) successfully deleted
I20260619 02:46:22.821475 24627 ts_tablet_manager.cc:1918] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:46:22.823475 24627 log.cc:1196] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/dd3073af641d487c80887005c2492de8
I20260619 02:46:22.824075 24627 ts_tablet_manager.cc:1939] T dd3073af641d487c80887005c2492de8 P 66355a748de84f1396fc2b65c060c60c: Deleting consensus metadata
I20260619 02:46:22.824496 24088 catalog_manager.cc:4841] TS 66355a748de84f1396fc2b65c060c60c (127.12.145.66:35713): tablet dd3073af641d487c80887005c2492de8 (table test-table [id=75356cc8fe9b422dad55e5cca4000d42]) successfully deleted
W20260619 02:46:22.824910 24086 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:36521 (error 108)
I20260619 02:46:22.825201 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 24321
I20260619 02:46:22.825866 24597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:46:22.825735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:36521 (local address 127.0.0.1:39650)
0619 02:46:22.825796 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0619 02:46:22.825828 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:36521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260619 02:46:22.826072 24086 catalog_manager.cc:4584] TS 8be5fa2dcdbb428ca4fff65b5acc3570 (127.12.145.65:36521): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd3073af641d487c80887005c2492de8: Network error: Client connection negotiation failed: client connection to 127.12.145.65:36521: connect: Connection refused (error 111)
I20260619 02:46:22.831137 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 24456
I20260619 02:46:22.835847 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 24069
I20260619 02:46:22.842159 12869 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260619 02:46:23.186335 12869 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260619 02:46:23.186434 12869 mini_ranger.cc:66] Stopping Ranger...
I20260619 02:46:23.530663 12869 mini_ranger.cc:68] Stopped Ranger
2026-06-19 02:46:23.530 UTC [23655] LOG: received smart shutdown request
2026-06-19 02:46:23.534 UTC [23655] LOG: background worker "logical replication launcher" (PID 23664) exited with exit code 1
2026-06-19 02:46:23.534 UTC [23659] LOG: shutting down
2026-06-19 02:46:23.695 UTC [23655] LOG: database system is shut down
2026-06-19T02:46:23Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45082 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:46:23 dist-test-slave-fbl4 krb5kdc[24638](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:46:23 dist-test-slave-fbl4 krb5kdc[24638](info): set up 2 sockets
Jun 19 02:46:23 dist-test-slave-fbl4 krb5kdc[24638](info): commencing operation
krb5kdc: starting...
W20260619 02:46:24.830504 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:46:24 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:46:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:46:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/rangeradmin_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/rangeradmin_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/rangerlookup_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/rangerlookup_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
I20260619 02:46:24.989960 12869 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskus8Nkk/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/postgres -l logfile start
2026-06-19 02:46:27.472 UTC [24668] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-19 02:46:27.472 UTC [24668] LOG: listening on IPv4 address "127.12.145.84", port 35789
2026-06-19 02:46:27.476 UTC [24668] LOG: listening on Unix socket "/tmp/.s.PGSQL.35789"
2026-06-19 02:46:27.497 UTC [24671] LOG: database system was shut down at 2026-06-19 02:46:26 UTC
2026-06-19 02:46:27.500 UTC [24668] LOG: database system is ready to accept connections
I20260619 02:46:28.458758 12869 mini_postgres.cc:96] Postgres bound to 35789
2026-06-19 02:46:28.464 UTC [24679] FATAL: database "slave" does not exist
127.12.145.84:35789 - accepting connections
I20260619 02:46:28.465328 12869 mini_ranger.cc:161] Starting Ranger...
I20260619 02:46:28.479585 12869 mini_ranger.cc:84] Created miniranger Postgres user
I20260619 02:46:28.971030 12869 mini_ranger.cc:87] Created ranger Postgres database
I20260619 02:46:28.971118 12869 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-admin
2026-06-19 02:46:29,248 [I] DB FLAVOR :POSTGRES
2026-06-19 02:46:29,249 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 02:46:29,249 [I] Checking connection..
2026-06-19 02:46:29,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-19 02:46:29,487 [I] Checking connection passed.
2026-06-19 02:46:29,487 [I] --------- Verifying version history table ---------
2026-06-19 02:46:29,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 02:46:29,715 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 02:46:29,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 02:46:29,938 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 02:46:29,939 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-19 02:46:29,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-19 02:46:30.157 UTC [24743] WARNING: there is no transaction in progress
2026-06-19 02:46:30,163 [I] create_dbversion_catalog.sql file imported successfully
2026-06-19 02:46:30,163 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 02:46:30,413 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-19 02:46:30,414 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 02:46:30,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-19 02:46:30,664 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-19 02:46:30,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-fbl4.c.gcp-upstream.internal','N') ;"
2026-06-19 02:46:31,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 02:46:31,385 [I] Table x_portal_user does not exist in database ranger
2026-06-19 02:46:31,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 02:46:31,615 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-19 02:46:31,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 02:46:31,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 02:46:32,098 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-19 02:46:32,098 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-19 02:46:33.037 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.054 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.071 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.087 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.102 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.123 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.176 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.183 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.197 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.208 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.219 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.233 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.244 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.250 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.258 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33.265 UTC [24851] WARNING: there is no transaction in progress
2026-06-19 02:46:33,902 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-19 02:46:33,903 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-19 02:46:34,125 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-19 02:46:34,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 02:46:34,383 [I] Table x_portal_user already exists in database 'ranger'
2026-06-19 02:46:34,383 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 02:46:34,618 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-19 02:46:34,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 02:46:34,878 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 02:46:35,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-fbl4.c.gcp-upstream.internal';"
2026-06-19 02:46:35,349 [I] CORE_DB_SCHEMA import status has been updated
2026-06-19 02:46:35,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-19 02:46:35,586 [I] DB_PATCHES have already been applied
I20260619 02:46:35.591681 12869 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-admin:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskus8Nkk/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260619 02:46:35.591779 12869 mini_ranger.cc:193] Using host: 127.12.145.84
I20260619 02:46:35.594897 12869 mini_ranger.cc:227] Ranger admin URL: http://127.12.145.84:48531
Jun 19, 2026 2:46:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 2:46:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 2:46:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp
Jun 19, 2026 2:46:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 19, 2026 2:46:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 19, 2026 2:46:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-admin/ews/webapp].
Jun 19, 2026 2:46:36 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260619 02:46:36.705091 12869 mini_ranger.cc:160] Time spent starting Ranger: real 8.240s user 0.000s sys 0.008s
Jun 19, 2026 2:46:55 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 19, 2026 2:46:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 19, 2026 2:46:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 19, 2026 2:46:55 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 19, 2026 2:46:56 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260619 02:46:57.319281 12869 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.145.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.145.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/rangerkms_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.145.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/rangerkms_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.145.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.145.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.145.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/HTTP_127.12.145.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 19 02:46:57 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837217, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260619 02:46:57.408228 12869 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260619 02:46:57.417008 12869 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260619 02:46:58.202829 12869 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260619 02:46:58.202912 12869 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms
I20260619 02:46:58.202930 12869 mini_ranger_kms.cc:227] Using postgres at 127.12.145.84:35789
2026-06-19 02:46:58,365 [I] DB FLAVOR :POSTGRES
2026-06-19 02:46:58,366 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 02:46:58,366 [I] Checking connection
2026-06-19 02:46:58,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-19 02:46:58,602 [I] connection success
2026-06-19 02:46:58,602 [I] --------- Verifying Ranger DB tables ---------
2026-06-19 02:46:58,602 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-19 02:46:58,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-19 02:46:58,827 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-19 02:46:58,827 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 02:46:58,827 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-19 02:46:58,827 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.145.84:35789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-19 02:46:59,074 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260619 02:46:59.560948 12869 mini_ranger_kms.cc:310] Created kms service
I20260619 02:46:59.785044 12869 mini_ranger_kms.cc:326] Created kudu user
I20260619 02:46:59.826721 12869 mini_ranger_kms.cc:343] Created rangerkms user
Jun 19 02:46:59 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837217, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:00.219328 12869 mini_ranger_kms.cc:384] Added ranger policy
I20260619 02:47:00.219543 12869 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms:/tmp/dist-test-taskus8Nkk/build/release/bin/postgresql.jar:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskus8Nkk/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260619 02:47:00.219591 12869 mini_ranger_kms.cc:240] Using host: 127.12.145.84
I20260619 02:47:00.223114 12869 mini_ranger_kms.cc:276] Ranger KMS PID: 25031
I20260619 02:47:00.223192 12869 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.145.84:55011
Jun 19, 2026 2:47:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 2:47:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 2:47:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 19, 2026 2:47:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 19, 2026 2:47:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-kms/ews/webapp].
Jun 19, 2026 2:47:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260619 02:47:02.445926 12869 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.038s user 0.012s sys 0.135s
I20260619 02:47:02.446036 12869 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260619 02:47:02.446110 12869 mini_ranger_kms.cc:401] 127.12.145.84:55011/kms/v1/keys
Jun 19 02:47:02 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781837222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 19 02:47:03 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.84@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
Jun 19 02:47:03 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.145.84@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
Jun 19 02:47:05 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:47:05.621445 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34633
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34633
--ranger_config_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:05.715041 25082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:05.715229 25082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:05.715250 25082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:05.716423 25082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:05.716463 25082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:05.716478 25082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:05.716490 25082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:05.716543 25082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:05.717998 25082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.145.84:55011/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34633
--ranger_config_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:05.718233 25082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:05.718461 25082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:05.723255 25090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:05.723332 25082 server_base.cc:1034] running on GCE node
W20260619 02:47:05.723315 25088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:05.723256 25087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:05.723734 25082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:05.724038 25082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:05.725201 25082 hybrid_clock.cc:648] HybridClock initialized: now 1781837225725191 us; error 46 us; skew 500 ppm
Jun 19 02:47:05 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837225, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:05.727948 25082 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:05.728359 25082 webserver.cc:460] Webserver started at http://127.12.145.126:33583/ using document root <none> and password file <none>
I20260619 02:47:05.728578 25082 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:05.728636 25082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:05.728790 25082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:47:05 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837225, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:05.781332 25082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "0c62894309464d7f8566c6ed52db3d4e"
format_stamp: "Formatted at 2026-06-19 02:47:05 on dist-test-slave-fbl4"
server_key: "03c9a79f762fcc84f31b89aa7fee1571"
server_key_iv: "d8de44572993e3367753139172d10939"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:05.781731 25082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "0c62894309464d7f8566c6ed52db3d4e"
format_stamp: "Formatted at 2026-06-19 02:47:05 on dist-test-slave-fbl4"
server_key: "03c9a79f762fcc84f31b89aa7fee1571"
server_key_iv: "d8de44572993e3367753139172d10939"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:05.783295 25082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:47:05.797240 25097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:05.797433 25082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:05.797544 25082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "0c62894309464d7f8566c6ed52db3d4e"
format_stamp: "Formatted at 2026-06-19 02:47:05 on dist-test-slave-fbl4"
server_key: "03c9a79f762fcc84f31b89aa7fee1571"
server_key_iv: "d8de44572993e3367753139172d10939"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:05.797624 25082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:05.812462 25082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:05.814373 25082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:05.814515 25082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:05.819438 25082 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:34633
I20260619 02:47:05.819464 25149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:34633 every 8 connection(s)
I20260619 02:47:05.819852 25082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:05.820523 25150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:05.822883 25150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Bootstrap starting.
I20260619 02:47:05.823438 25150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:05.823719 25150 log.cc:824] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:05.824404 25150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: No bootstrap required, opened a new log
I20260619 02:47:05.826371 25150 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:05.826531 25150 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:05.826598 25150 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c62894309464d7f8566c6ed52db3d4e, State: Initialized, Role: FOLLOWER
I20260619 02:47:05.826783 25150 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:05.826872 25150 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:05.826912 25150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:05.826957 25150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:05.827350 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25082
I20260619 02:47:05.827454 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:47:05.827656 12869 external_mini_cluster.cc:1428] Setting key 29e38db55c05e6aed931a38055c43f5b
I20260619 02:47:05.827672 25150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:05.827765 25150 leader_election.cc:302] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c62894309464d7f8566c6ed52db3d4e; no voters:
I20260619 02:47:05.827970 25150 leader_election.cc:288] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:47:05.827993 25153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:05.828099 25153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 LEADER]: Becoming Leader. State: Replica: 0c62894309464d7f8566c6ed52db3d4e, State: Running, Role: LEADER
I20260619 02:47:05.828176 25153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:05.828217 25150 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:05.828476 25153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c62894309464d7f8566c6ed52db3d4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } } }
I20260619 02:47:05.828605 25153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:05.828806 25153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c62894309464d7f8566c6ed52db3d4e. Latest consensus state: current_term: 1 leader_uuid: "0c62894309464d7f8566c6ed52db3d4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } } }
I20260619 02:47:05.828876 25153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:05.829537 25150 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 02:47:05.833616 25162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:05.834417 25162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:05.836335 25162 catalog_manager.cc:1347] Generated new cluster ID: 676f804332584558b48532f3c42b16bd
I20260619 02:47:05.836377 25162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:47:05 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:05.843840 25157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:05.828313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57342 (local address 127.12.145.126:34633)
0619 02:47:05.832230 (+ 3917us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:05.832254 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:05.832310 (+ 56us) server_negotiation.cc:407] Connection header received
0619 02:47:05.832552 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:05.832560 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:05.832642 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:05.832810 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:05.833981 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:05.835683 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:05.836775 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:05.837354 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:05.840040 (+ 2686us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:05.840123 (+ 83us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:05.840126 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:05.840126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:05.840134 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:05.841935 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:05.842332 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:05.842334 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:05.842335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:05.842442 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:05.842668 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:05.842669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:05.842669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:05.842945 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:05.843449 (+ 504us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:05.843523 (+ 74us) server_negotiation.cc:299] Negotiation successful
0619 02:47:05.843630 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3755,"thread_start_us":73,"threads_started":1}
I20260619 02:47:05.848069 25162 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:47:05.849092 25162 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:05.854490 25162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Generated new TSK 0
I20260619 02:47:05.854748 25162 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:47:06.533677 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34633
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:06.640807 25195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:06.641113 25195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:06.641176 25195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:06.642669 25195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:06.642738 25195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:06.642783 25195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:47:06.644618 25195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.145.84:55011/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34633
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:06.644878 25195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:06.645128 25195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:06.649940 25205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:06.650116 25203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:06.650017 25202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:06.650477 25195 server_base.cc:1034] running on GCE node
I20260619 02:47:06.650698 25195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:06.650961 25195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:06.652130 25195 hybrid_clock.cc:648] HybridClock initialized: now 1781837226652111 us; error 31 us; skew 500 ppm
Jun 19 02:47:06 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837226, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:06.655009 25195 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:47:06.655439 25195 webserver.cc:460] Webserver started at http://127.12.145.65:46779/ using document root <none> and password file <none>
I20260619 02:47:06.655689 25195 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:06.655757 25195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:06.655889 25195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:47:06 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837226, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:06.669315 25195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "d2df03238e93421ca7f47fc6af356c0e"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "4a137ae94bc4c54aab27f0fcd9342524"
server_key_iv: "3fa7a081cb33c31f0c8bd2693939ef05"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:06.669845 25195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "d2df03238e93421ca7f47fc6af356c0e"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "4a137ae94bc4c54aab27f0fcd9342524"
server_key_iv: "3fa7a081cb33c31f0c8bd2693939ef05"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:06.673671 25195 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260619 02:47:06.690768 25212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:06.691038 25195 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.001s
I20260619 02:47:06.691167 25195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "d2df03238e93421ca7f47fc6af356c0e"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "4a137ae94bc4c54aab27f0fcd9342524"
server_key_iv: "3fa7a081cb33c31f0c8bd2693939ef05"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:06.691277 25195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:06.714713 25195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:06.717196 25195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:06.717396 25195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:06.717702 25195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:06.718080 25195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:06.718163 25195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:06.718262 25195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:06.718333 25195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:06.724969 25195 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:45587
I20260619 02:47:06.725476 25195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:47:06.727607 25325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:45587 every 8 connection(s)
I20260619 02:47:06.733361 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25195
I20260619 02:47:06.733470 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:47:06.733656 12869 external_mini_cluster.cc:1428] Setting key 603950c361eeef60810ddad6f31e0f0e
Jun 19 02:47:06 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837226, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
I20260619 02:47:06.753005 25328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:06.728465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34633 (local address 127.12.145.65:36243)
0619 02:47:06.742665 (+ 14200us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:06.742715 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:06.743235 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:06.743527 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:06.743532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:06.743779 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:06.744076 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:06.744083 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:06.745145 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:06.745146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:06.746452 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:06.746455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:06.747062 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:06.747063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:06.747211 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:06.747853 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:06.747863 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:06.749407 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:06.751384 (+ 1977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:06.751390 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:06.751393 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:06.751669 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:06.751871 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:06.751872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:06.751872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:06.751994 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:06.752292 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:06.752298 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:06.752452 (+ 154us) client_negotiation.cc:769] Sending connection context
0619 02:47:06.752572 (+ 120us) client_negotiation.cc:240] Negotiation successful
0619 02:47:06.752749 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14153,"thread_start_us":69,"threads_started":1}
I20260619 02:47:06.753572 25329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:06.728482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:36243 (local address 127.12.145.126:34633)
0619 02:47:06.735969 (+ 7487us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:06.735971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:06.742808 (+ 6837us) server_negotiation.cc:407] Connection header received
0619 02:47:06.743338 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:06.743339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:06.743352 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:06.744178 (+ 826us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:06.744228 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:06.745035 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:06.746577 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:06.746905 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:06.746969 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:06.749510 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:06.749512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:06.749512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:06.749519 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:06.751297 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:06.751749 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:06.751750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:06.751750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:06.751810 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:06.752076 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:06.752077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:06.752077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:06.752211 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:06.752267 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:06.753359 (+ 1092us) server_negotiation.cc:299] Negotiation successful
0619 02:47:06.753459 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7453,"thread_start_us":92,"threads_started":1}
I20260619 02:47:06.754416 25326 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34633
I20260619 02:47:06.754506 25326 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:06.754727 25326 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:06.755288 25114 ts_manager.cc:194] Registered new tserver with Master: d2df03238e93421ca7f47fc6af356c0e (127.12.145.65:45587)
I20260619 02:47:06.756103 25114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:36243
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:47:06.786767 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34633
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 02:47:06 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781837226, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260619 02:47:06.921598 25334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:06.921854 25334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:06.921895 25334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:06.923100 25334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:06.923162 25334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:06.923205 25334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:47:06.924614 25334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.145.84:55011/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34633
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:06.924863 25334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:06.925137 25334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:06.933050 25339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:06.933033 25342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:06.933666 25340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:06.935338 25334 server_base.cc:1034] running on GCE node
I20260619 02:47:06.935549 25334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:06.935815 25334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:06.936988 25334 hybrid_clock.cc:648] HybridClock initialized: now 1781837226936964 us; error 39 us; skew 500 ppm
Jun 19 02:47:06 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837226, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:06.944777 25334 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:47:06.945288 25334 webserver.cc:460] Webserver started at http://127.12.145.66:35535/ using document root <none> and password file <none>
I20260619 02:47:06.945538 25334 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:06.945587 25334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:06.945708 25334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:47:06 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837226, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:06.959890 25334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "523de0d105ca4746b4b95b6a3dd08caf"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "be9417f6d628aff14d9d7ec170f6c1e2"
server_key_iv: "67d27470290fc77331f0d618a77c3f16"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:06.960436 25334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "523de0d105ca4746b4b95b6a3dd08caf"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "be9417f6d628aff14d9d7ec170f6c1e2"
server_key_iv: "67d27470290fc77331f0d618a77c3f16"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:06.966164 25334 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.000s
I20260619 02:47:06.979861 25350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:06.980086 25334 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:06.980278 25334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "523de0d105ca4746b4b95b6a3dd08caf"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "be9417f6d628aff14d9d7ec170f6c1e2"
server_key_iv: "67d27470290fc77331f0d618a77c3f16"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:06.980378 25334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:07.002832 25334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:07.005339 25334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:07.005501 25334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:07.005745 25334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:07.006129 25334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:07.006189 25334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.006225 25334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:07.006270 25334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.012343 25334 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:45635
I20260619 02:47:07.012818 25334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:47:07.016552 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25334
I20260619 02:47:07.016650 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:47:07.016839 12869 external_mini_cluster.cc:1428] Setting key 94be3ddcfc0285db67b754eb5adcebc8
I20260619 02:47:07.020818 25463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:45635 every 8 connection(s)
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837226, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:07.039194 25329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.022766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:60085 (local address 127.12.145.126:34633)
0619 02:47:07.022839 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:07.022841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:07.027795 (+ 4954us) server_negotiation.cc:407] Connection header received
0619 02:47:07.028553 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:07.028556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:07.028574 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:07.028650 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:07.030396 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.031250 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.032762 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.033081 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.033123 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.035863 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:07.035864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:07.035865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:07.035872 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:07.037620 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.038090 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.038092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.038092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.038146 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.038409 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.038410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.038410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.038578 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:07.038623 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:07.038985 (+ 362us) server_negotiation.cc:299] Negotiation successful
0619 02:47:07.039074 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260619 02:47:07.039945 25467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.022459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34633 (local address 127.12.145.66:60085)
0619 02:47:07.027627 (+ 5168us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:07.027686 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:07.028406 (+ 720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:07.029737 (+ 1331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:07.029741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:07.029996 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:07.030281 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.030287 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.031369 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.031370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.032660 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.032663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.033224 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.033225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.033360 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.034003 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:07.034014 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:07.035751 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:07.037715 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.037721 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.037724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.038003 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.038213 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.038213 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.038214 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.038333 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.038671 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:07.038677 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:07.038833 (+ 156us) client_negotiation.cc:769] Sending connection context
0619 02:47:07.039551 (+ 718us) client_negotiation.cc:240] Negotiation successful
0619 02:47:07.039710 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5109,"thread_start_us":107,"threads_started":1}
I20260619 02:47:07.040627 25464 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34633
I20260619 02:47:07.040715 25464 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.040892 25464 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:07.041290 25114 ts_manager.cc:194] Registered new tserver with Master: 523de0d105ca4746b4b95b6a3dd08caf (127.12.145.66:45635)
I20260619 02:47:07.041790 25114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:60085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:47:07.058984 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34633
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:07.182020 25469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:07.182366 25469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:07.182447 25469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:07.184124 25469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:07.184239 25469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:07.184334 25469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:47:07.186538 25469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.145.84:55011/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34633
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:07.187027 25469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:07.187311 25469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:07.193380 25475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:07.193573 25477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:07.194154 25469 server_base.cc:1034] running on GCE node
W20260619 02:47:07.194222 25474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:07.194504 25469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:07.194818 25469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:07.196048 25469 hybrid_clock.cc:648] HybridClock initialized: now 1781837227196031 us; error 34 us; skew 500 ppm
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:07.199236 25469 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:47:07.199772 25469 webserver.cc:460] Webserver started at http://127.12.145.67:36883/ using document root <none> and password file <none>
I20260619 02:47:07.200052 25469 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:07.200115 25469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:07.200249 25469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:07.212884 25469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da"
format_stamp: "Formatted at 2026-06-19 02:47:07 on dist-test-slave-fbl4"
server_key: "3d8a922101f537ae19379f8c7b54d2b7"
server_key_iv: "871bb854fb269fdfde1d83f9ba4f0ed2"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:07.213330 25469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da"
format_stamp: "Formatted at 2026-06-19 02:47:07 on dist-test-slave-fbl4"
server_key: "3d8a922101f537ae19379f8c7b54d2b7"
server_key_iv: "871bb854fb269fdfde1d83f9ba4f0ed2"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:07.215204 25469 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260619 02:47:07.230290 25484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.230623 25469 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:07.230731 25469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da"
format_stamp: "Formatted at 2026-06-19 02:47:07 on dist-test-slave-fbl4"
server_key: "3d8a922101f537ae19379f8c7b54d2b7"
server_key_iv: "871bb854fb269fdfde1d83f9ba4f0ed2"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:07.230831 25469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:07.258781 25469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:07.261190 25469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:07.261332 25469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:07.261585 25469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:07.261924 25469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:07.261972 25469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.262009 25469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:07.262027 25469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.268680 25469 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:43131
I20260619 02:47:07.269088 25469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:47:07.270692 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25469
I20260619 02:47:07.270808 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:47:07.271018 12869 external_mini_cluster.cc:1428] Setting key 17a0b80b2bdf1d84331db5a6517ef89d
I20260619 02:47:07.272765 25597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:43131 every 8 connection(s)
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:07.283982 25329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.271952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:46891 (local address 127.12.145.126:34633)
0619 02:47:07.271994 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:07.271996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:07.273183 (+ 1187us) server_negotiation.cc:407] Connection header received
0619 02:47:07.273859 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:07.273860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:07.273872 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:07.273902 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:07.274747 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.275456 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.276998 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.277297 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.277340 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.279902 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:07.279903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:07.279904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:07.279911 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:07.281624 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.282091 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.282092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.282092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.282149 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.282399 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.282400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.282400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.282584 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:07.282632 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:07.283779 (+ 1147us) server_negotiation.cc:299] Negotiation successful
0619 02:47:07.283866 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:47:07.284528 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.271627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34633 (local address 127.12.145.67:46891)
0619 02:47:07.273066 (+ 1439us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:07.273107 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:07.273744 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:07.274082 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:07.274086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:07.274319 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:07.274631 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.274638 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.275581 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.275582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.276902 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.276904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.277438 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.277439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.277588 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.278173 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:07.278183 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:07.279794 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:07.281716 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.281723 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.281726 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.282002 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.282213 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.282214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.282214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.282332 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.283387 (+ 1055us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:07.283394 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:07.283568 (+ 174us) client_negotiation.cc:769] Sending connection context
0619 02:47:07.284131 (+ 563us) client_negotiation.cc:240] Negotiation successful
0619 02:47:07.284289 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1397,"thread_start_us":88,"threads_started":1}
I20260619 02:47:07.284967 25598 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34633
I20260619 02:47:07.285061 25598 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.285243 25598 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:07.285573 25114 ts_manager.cc:194] Registered new tserver with Master: 8a0dbe516b7f4b0ab51ec8dbcbd9f8da (127.12.145.67:43131)
I20260619 02:47:07.286058 25114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:46891
I20260619 02:47:07.293942 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:47:07.294732 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25195
I20260619 02:47:07.302839 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25334
I20260619 02:47:07.308676 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25469
I20260619 02:47:07.315291 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25082
I20260619 02:47:07.320729 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34633
--webserver_interface=127.12.145.126
--webserver_port=33583
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34633
--ranger_config_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:07.415835 25601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:07.416064 25601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:07.416096 25601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:07.417268 25601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:07.417333 25601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:07.417357 25601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:07.417378 25601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:07.417407 25601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:07.419040 25601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34633
--ranger_config_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=33583
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:07.419301 25601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:07.419530 25601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:07.425318 25609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:07.425340 25607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:07.425428 25606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:07.425661 25601 server_base.cc:1034] running on GCE node
I20260619 02:47:07.425910 25601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:07.426306 25601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:07.427520 25601 hybrid_clock.cc:648] HybridClock initialized: now 1781837227427509 us; error 35 us; skew 500 ppm
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:07.430351 25601 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:07.430879 25601 webserver.cc:460] Webserver started at http://127.12.145.126:33583/ using document root <none> and password file <none>
I20260619 02:47:07.431094 25601 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:07.431167 25601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:07.503571 25601 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:07.504351 25617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.504601 25601 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:07.504729 25601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "0c62894309464d7f8566c6ed52db3d4e"
format_stamp: "Formatted at 2026-06-19 02:47:05 on dist-test-slave-fbl4"
server_key: "03c9a79f762fcc84f31b89aa7fee1571"
server_key_iv: "d8de44572993e3367753139172d10939"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:07.505125 25601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:07.514410 25601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:07.515996 25601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:07.516147 25601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:07.520016 25601 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:34633
I20260619 02:47:07.520049 25669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:34633 every 8 connection(s)
I20260619 02:47:07.520403 25601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:07.521562 25670 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:47:07.522106 25670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Bootstrap starting.
I20260619 02:47:07.527349 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25601
I20260619 02:47:07.527642 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:45587
--local_ip_for_outbound_sockets=127.12.145.65
--tserver_master_addrs=127.12.145.126:34633
--webserver_port=46779
--webserver_interface=127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:07.529893 25670 log.cc:824] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:07.531629 25670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:47:07.531891 25670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Bootstrap complete.
I20260619 02:47:07.534143 25670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:07.534389 25670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c62894309464d7f8566c6ed52db3d4e, State: Initialized, Role: FOLLOWER
I20260619 02:47:07.534608 25670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:07.534711 25670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:07.534765 25670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:07.534811 25670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 1 FOLLOWER]: Advancing to term 2
I20260619 02:47:07.535760 25670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:07.535876 25670 leader_election.cc:302] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c62894309464d7f8566c6ed52db3d4e; no voters:
I20260619 02:47:07.536060 25670 leader_election.cc:288] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 02:47:07.536092 25674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 2 FOLLOWER]: Leader election won for term 2
I20260619 02:47:07.536193 25674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [term 2 LEADER]: Becoming Leader. State: Replica: 0c62894309464d7f8566c6ed52db3d4e, State: Running, Role: LEADER
I20260619 02:47:07.536283 25674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } }
I20260619 02:47:07.536314 25670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:07.536557 25675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c62894309464d7f8566c6ed52db3d4e. Latest consensus state: current_term: 2 leader_uuid: "0c62894309464d7f8566c6ed52db3d4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } } }
I20260619 02:47:07.536656 25675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:07.536834 25676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0c62894309464d7f8566c6ed52db3d4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c62894309464d7f8566c6ed52db3d4e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34633 } } }
I20260619 02:47:07.536904 25676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:07.537007 25679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:07.537526 25679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:07.537673 25679 catalog_manager.cc:1259] Loaded cluster ID: 676f804332584558b48532f3c42b16bd
I20260619 02:47:07.537719 25679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:47:07.537871 25670 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 02:47:07.541392 25679 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:07.542022 25679 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Loaded TSK: 0
I20260619 02:47:07.542344 25679 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 02:47:07.639346 25672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:07.639611 25672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:07.639647 25672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:07.641243 25672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:07.641294 25672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:07.641333 25672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:47:07.643404 25672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:45587
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=46779
--tserver_master_addrs=127.12.145.126:34633
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:07.643663 25672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:07.643980 25672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:07.650276 25707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:07.650373 25708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:07.650442 25710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:07.651707 25672 server_base.cc:1034] running on GCE node
I20260619 02:47:07.651933 25672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:07.652235 25672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:07.653411 25672 hybrid_clock.cc:648] HybridClock initialized: now 1781837227653395 us; error 36 us; skew 500 ppm
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:07.656702 25672 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:47:07.657321 25672 webserver.cc:460] Webserver started at http://127.12.145.65:46779/ using document root <none> and password file <none>
I20260619 02:47:07.657675 25672 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:07.657828 25672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:07.691077 25672 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.001s sys 0.000s
I20260619 02:47:07.692226 25718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.692655 25672 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:07.692749 25672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "d2df03238e93421ca7f47fc6af356c0e"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "4a137ae94bc4c54aab27f0fcd9342524"
server_key_iv: "3fa7a081cb33c31f0c8bd2693939ef05"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:07.693877 25672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:07.717916 25672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:07.720467 25672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:07.720692 25672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:07.720959 25672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:07.721365 25672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:07.721452 25672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.721575 25672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:07.721649 25672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.728848 25672 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:45587
I20260619 02:47:07.729146 25831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:45587 every 8 connection(s)
I20260619 02:47:07.729391 25672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:47:07.730773 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25672
I20260619 02:47:07.731108 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:45635
--local_ip_for_outbound_sockets=127.12.145.66
--tserver_master_addrs=127.12.145.126:34633
--webserver_port=35535
--webserver_interface=127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:07.742710 25834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.730230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34633 (local address 127.12.145.65:43677)
0619 02:47:07.731385 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:07.731419 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:07.731947 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:07.732413 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:07.732416 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:07.732676 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:07.732915 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.732920 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.734065 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.734066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.735092 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.735095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.736016 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.736018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.736158 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.736811 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:07.736821 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:07.738470 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:07.740744 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.740751 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.740753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.741053 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.741347 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.741348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.741349 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.741483 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.741989 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:07.741995 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:07.742146 (+ 151us) client_negotiation.cc:769] Sending connection context
0619 02:47:07.742248 (+ 102us) client_negotiation.cc:240] Negotiation successful
0619 02:47:07.742410 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1118,"thread_start_us":89,"threads_started":1}
I20260619 02:47:07.743366 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.730625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:43677 (local address 127.12.145.126:34633)
0619 02:47:07.730826 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:07.730837 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:07.731549 (+ 712us) server_negotiation.cc:407] Connection header received
0619 02:47:07.732184 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:07.732189 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:07.732232 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:07.732375 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:07.733048 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.733918 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.735193 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.735805 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.735911 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.738631 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:07.738635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:07.738636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:07.738649 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:07.740641 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.741153 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.741156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.741157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.741268 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.741577 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.741578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.741578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.741877 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:07.741959 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:07.743037 (+ 1078us) server_negotiation.cc:299] Negotiation successful
0619 02:47:07.743168 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":97,"threads_started":1}
I20260619 02:47:07.744107 25832 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34633
I20260619 02:47:07.744210 25832 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.744400 25832 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
W20260619 02:47:07.745231 25832 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:34633 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 02:47:07.745337 25832 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.745438 25832 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:07.745815 25832 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.745927 25832 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
W20260619 02:47:07.746227 25832 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 02:47:07.842806 25836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:07.843024 25836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:07.843047 25836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:07.844679 25836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:07.844803 25836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:07.844895 25836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:47:07.846401 25836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:45635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=35535
--tserver_master_addrs=127.12.145.126:34633
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:07.846647 25836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:07.846903 25836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:07.852655 25841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:07.852700 25844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:07.852656 25842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:07.853664 25836 server_base.cc:1034] running on GCE node
I20260619 02:47:07.853924 25836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:07.854218 25836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:07.855438 25836 hybrid_clock.cc:648] HybridClock initialized: now 1781837227855436 us; error 50 us; skew 500 ppm
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:07.858675 25836 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:47:07.859261 25836 webserver.cc:460] Webserver started at http://127.12.145.66:35535/ using document root <none> and password file <none>
I20260619 02:47:07.859598 25836 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:07.859701 25836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:07.878194 25836 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:07.879258 25852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.879503 25836 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:07.879611 25836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "523de0d105ca4746b4b95b6a3dd08caf"
format_stamp: "Formatted at 2026-06-19 02:47:06 on dist-test-slave-fbl4"
server_key: "be9417f6d628aff14d9d7ec170f6c1e2"
server_key_iv: "67d27470290fc77331f0d618a77c3f16"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:07.880092 25836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:07.896173 25836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:07.898270 25836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:07.898435 25836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:07.898732 25836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:07.899125 25836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:07.899176 25836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.899206 25836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:07.899226 25836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:07.906576 25836 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:45635
I20260619 02:47:07.906893 25965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:45635 every 8 connection(s)
I20260619 02:47:07.907248 25836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:47:07 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837227, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:07.914630 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25836
I20260619 02:47:07.914897 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.145.84:55011/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:43131
--local_ip_for_outbound_sockets=127.12.145.67
--tserver_master_addrs=127.12.145.126:34633
--webserver_port=36883
--webserver_interface=127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:07.918813 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.907973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:42771 (local address 127.12.145.126:34633)
0619 02:47:07.908053 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:07.908056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:07.908509 (+ 453us) server_negotiation.cc:407] Connection header received
0619 02:47:07.908860 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:07.908861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:07.908877 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:07.908936 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:07.909666 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.910153 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.911239 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.911466 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.911554 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.913613 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:07.913614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:07.913615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:07.913623 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:07.916933 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.917507 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.917508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.917509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.917590 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:07.917969 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:07.917970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:07.917970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:07.918147 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:07.918217 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:07.918583 (+ 366us) server_negotiation.cc:299] Negotiation successful
0619 02:47:07.918681 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 02:47:07.918967 25968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:07.907975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34633 (local address 127.12.145.66:42771)
0619 02:47:07.908138 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:07.908179 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:07.908720 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:07.909009 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:07.909013 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:07.909301 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:07.909553 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.909558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.910248 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.910249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.911130 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:07.911132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:07.911582 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:07.911583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:07.911695 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:07.912271 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:07.912287 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:07.913519 (+ 1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:07.917055 (+ 3536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.917062 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.917064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.917415 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.917681 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:07.917682 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:07.917682 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:07.917885 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:07.918229 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:07.918235 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:07.918396 (+ 161us) client_negotiation.cc:769] Sending connection context
0619 02:47:07.918523 (+ 127us) client_negotiation.cc:240] Negotiation successful
0619 02:47:07.918727 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260619 02:47:07.919636 25966 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34633
I20260619 02:47:07.919749 25966 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.919960 25966 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
W20260619 02:47:07.920714 25966 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:34633 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 02:47:07.920796 25966 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.920876 25966 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:07.921284 25966 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:07.921376 25966 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
W20260619 02:47:07.921705 25966 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 02:47:08.013201 25969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:08.013458 25969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:08.013512 25969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:08.014736 25969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:08.014796 25969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:08.014840 25969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:47:08.016301 25969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.145.84:55011/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:43131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=36883
--tserver_master_addrs=127.12.145.126:34633
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:08.016564 25969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:08.016806 25969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:08.021941 25978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:08.022275 25976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:08.022413 25975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:08.024282 25969 server_base.cc:1034] running on GCE node
I20260619 02:47:08.024498 25969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:08.024772 25969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:08.028048 25969 hybrid_clock.cc:648] HybridClock initialized: now 1781837228028011 us; error 47 us; skew 500 ppm
Jun 19 02:47:08 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837228, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:08.031540 25969 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:47:08.032084 25969 webserver.cc:460] Webserver started at http://127.12.145.67:36883/ using document root <none> and password file <none>
I20260619 02:47:08.032370 25969 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:08.032442 25969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 02:47:08 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837228, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:08.047854 25969 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:08.052328 25986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:08.052551 25969 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260619 02:47:08.052654 25969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da"
format_stamp: "Formatted at 2026-06-19 02:47:07 on dist-test-slave-fbl4"
server_key: "3d8a922101f537ae19379f8c7b54d2b7"
server_key_iv: "871bb854fb269fdfde1d83f9ba4f0ed2"
server_key_version: "kuduclusterkey@0"
I20260619 02:47:08.053809 25969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:08.069698 25969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:08.071723 25969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:08.071859 25969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:08.072057 25969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:08.072374 25969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:08.072412 25969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:08.072439 25969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:08.072458 25969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:08.079434 25969 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:43131
I20260619 02:47:08.079509 26099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:43131 every 8 connection(s)
I20260619 02:47:08.079895 25969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:47:08.080951 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 25969
Jun 19 02:47:08 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837228, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:08.092543 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:08.080633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:55731 (local address 127.12.145.126:34633)
0619 02:47:08.080678 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:08.080680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:08.080983 (+ 303us) server_negotiation.cc:407] Connection header received
0619 02:47:08.083843 (+ 2860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:08.083844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:08.083855 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:08.083909 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:08.084497 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:08.085139 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:08.086594 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:08.086886 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:08.086930 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:08.089304 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:08.089306 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:08.089306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:08.089313 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:08.091012 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:08.091459 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:08.091460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:08.091460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:08.091517 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:08.091785 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:08.091786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:08.091786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:08.091901 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:08.091944 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:08.092323 (+ 379us) server_negotiation.cc:299] Negotiation successful
0619 02:47:08.092410 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:47:08.093322 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:08.080645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34633 (local address 127.12.145.67:55731)
0619 02:47:08.080841 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:08.080891 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:08.083732 (+ 2841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:08.083983 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:08.083987 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:08.084193 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:08.084371 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:08.084375 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:08.085251 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:08.085252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:08.086465 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:08.086468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:08.087046 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:08.087047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:08.087181 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:08.087741 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:08.087761 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:08.089197 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:08.091100 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:08.091106 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:08.091108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:08.091374 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:08.091597 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:08.091598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:08.091598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:08.091717 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:08.091991 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:08.092010 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:08.092164 (+ 154us) client_negotiation.cc:769] Sending connection context
0619 02:47:08.092902 (+ 738us) client_negotiation.cc:240] Negotiation successful
0619 02:47:08.093087 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260619 02:47:08.093971 26100 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34633
I20260619 02:47:08.094098 26100 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:08.094285 26100 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
W20260619 02:47:08.094904 26100 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:34633 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 02:47:08.094985 26100 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:08.095062 26100 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:08.095377 26100 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:08.095451 26100 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
W20260619 02:47:08.095917 26100 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 02:47:08.096333 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:08.081342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57356 (local address 127.12.145.126:34633)
0619 02:47:08.081664 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:08.081666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:08.081673 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:47:08.081698 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:08.081699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:08.081711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:08.081779 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:08.082612 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:08.083395 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:08.091603 (+ 8208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:08.091899 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:08.091957 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:08.093401 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:08.093403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:08.093403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:08.093410 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:08.095100 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:08.095469 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:08.095470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:08.095470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:08.095542 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:08.095754 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:08.095754 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:08.095755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:08.095888 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:08.096052 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:08.096147 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 02:47:08.096232 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":61,"threads_started":1}
Jun 19 02:47:08 dist-test-slave-fbl4 krb5kdc[24638](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781837228, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:08.746459 25832 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:08.746641 25832 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:08.746984 25634 ts_manager.cc:194] Registered new tserver with Master: d2df03238e93421ca7f47fc6af356c0e (127.12.145.65:45587)
I20260619 02:47:08.747972 25634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:43677
I20260619 02:47:08.921869 25966 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:08.922030 25966 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:08.922310 25634 ts_manager.cc:194] Registered new tserver with Master: 523de0d105ca4746b4b95b6a3dd08caf (127.12.145.66:45635)
I20260619 02:47:08.922868 25634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:42771
Jun 19 02:47:08 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837228, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:09.096098 26100 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:09.096249 26100 heartbeater.cc:511] Master 127.12.145.126:34633 requested a full tablet report, sending...
I20260619 02:47:09.096529 25634 ts_manager.cc:194] Registered new tserver with Master: 8a0dbe516b7f4b0ab51ec8dbcbd9f8da (127.12.145.67:43131)
I20260619 02:47:09.097088 25634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:55731
I20260619 02:47:09.105026 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:47:09.113910 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.106006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57372 (local address 127.12.145.126:34633)
0619 02:47:09.106132 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:09.106135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:09.106208 (+ 73us) server_negotiation.cc:407] Connection header received
0619 02:47:09.106289 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:09.106290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:09.106301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:09.106367 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:09.107072 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.107823 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.108907 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.109296 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.109369 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.110875 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:09.110877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:09.110877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:09.110885 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:09.112657 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:09.113065 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:09.113066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:09.113066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:09.113134 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:09.113354 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:09.113355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:09.113355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:09.113497 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:09.113594 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:09.113736 (+ 142us) server_negotiation.cc:299] Negotiation successful
0619 02:47:09.113814 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":78,"threads_started":1}
I20260619 02:47:09.116117 25634 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:47:09.118439 25634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:47:09.127081 26129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.121665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:45635 (local address 127.0.0.1:36416)
0619 02:47:09.122631 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:09.122640 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:09.122682 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:09.122871 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:09.122875 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:09.122877 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:09.122943 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.122945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.124410 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.124411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.125776 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.125779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.126798 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.126798 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.126869 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.126883 (+ 14us) client_negotiation.cc:769] Sending connection context
0619 02:47:09.126946 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 02:47:09.127004 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":950,"mutex_wait_us":40,"thread_start_us":67,"threads_started":1}
I20260619 02:47:09.127611 26131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.121756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36416 (local address 127.12.145.66:45635)
0619 02:47:09.122680 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:09.122685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:09.122722 (+ 37us) server_negotiation.cc:407] Connection header received
0619 02:47:09.122756 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:09.122758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:09.122774 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:09.122850 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:09.123040 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.124316 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.125872 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.126644 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.126710 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.126764 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:09.127483 (+ 719us) server_negotiation.cc:299] Negotiation successful
0619 02:47:09.127523 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":887,"thread_start_us":49,"threads_started":1}
I20260619 02:47:09.128494 25882 tablet_service.cc:1467] Processing CreateTablet for tablet 1141c609678e44f5a1fd8e52398f0377 (DEFAULT_TABLE table=test-table [id=4a8e8c38c1bf4ab5b54d941ee8ac1c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:09.128865 25882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1141c609678e44f5a1fd8e52398f0377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:09.128896 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.121433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45587 (local address 127.0.0.1:45180)
0619 02:47:09.121851 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:09.121890 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:09.121951 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:09.123138 (+ 1187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:09.123139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:09.123142 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:09.123199 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.123200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.124756 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.124757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.125916 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.125920 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.128695 (+ 2775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.128696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.128764 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.128768 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:09.128795 (+ 27us) client_negotiation.cc:240] Negotiation successful
0619 02:47:09.128831 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":80,"threads_started":1}
I20260619 02:47:09.129194 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.121682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45180 (local address 127.12.145.65:45587)
0619 02:47:09.122980 (+ 1298us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:09.122984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:09.122993 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:09.123024 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:09.123026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:09.123040 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:09.123268 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:09.123340 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.124648 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.126022 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.128592 (+ 2570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.128986 (+ 394us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.129051 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:09.129075 (+ 24us) server_negotiation.cc:299] Negotiation successful
0619 02:47:09.129125 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1265,"thread_start_us":56,"threads_started":1}
I20260619 02:47:09.131767 26128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.121441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:43131 (local address 127.0.0.1:54500)
0619 02:47:09.122036 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:09.122046 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:09.122095 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:09.127065 (+ 4970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:09.127065 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:09.127068 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:09.127108 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.127109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.129302 (+ 2193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.129303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.130538 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.130540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.131448 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.131449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.131504 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.131508 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:09.131534 (+ 26us) client_negotiation.cc:240] Negotiation successful
0619 02:47:09.131566 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":85,"threads_started":1}
I20260619 02:47:09.132108 26132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.121870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54500 (local address 127.12.145.67:43131)
0619 02:47:09.126911 (+ 5041us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:09.126917 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:09.126926 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:09.126957 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:09.126959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:09.126974 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:09.127168 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:09.127250 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.128241 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.130672 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.131356 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.131887 (+ 531us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.131970 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:09.131997 (+ 27us) server_negotiation.cc:299] Negotiation successful
0619 02:47:09.132037 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5005,"thread_start_us":60,"threads_started":1}
I20260619 02:47:09.132668 26018 tablet_service.cc:1467] Processing CreateTablet for tablet 1141c609678e44f5a1fd8e52398f0377 (DEFAULT_TABLE table=test-table [id=4a8e8c38c1bf4ab5b54d941ee8ac1c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:09.132710 25766 tablet_service.cc:1467] Processing CreateTablet for tablet 1141c609678e44f5a1fd8e52398f0377 (DEFAULT_TABLE table=test-table [id=4a8e8c38c1bf4ab5b54d941ee8ac1c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:09.132998 26018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1141c609678e44f5a1fd8e52398f0377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:09.133033 25766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1141c609678e44f5a1fd8e52398f0377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:09.137341 26134 tablet_bootstrap.cc:492] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Bootstrap starting.
I20260619 02:47:09.137957 26134 tablet_bootstrap.cc:654] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:09.137982 26135 tablet_bootstrap.cc:492] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e: Bootstrap starting.
I20260619 02:47:09.138257 26134 log.cc:824] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:09.138689 26133 tablet_bootstrap.cc:492] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Bootstrap starting.
I20260619 02:47:09.138814 26135 tablet_bootstrap.cc:654] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:09.139169 26135 log.cc:824] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:09.139235 26133 tablet_bootstrap.cc:654] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:09.139492 26133 log.cc:824] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:09.140046 26134 tablet_bootstrap.cc:492] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: No bootstrap required, opened a new log
I20260619 02:47:09.140132 26134 ts_tablet_manager.cc:1397] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260619 02:47:09.140368 26133 tablet_bootstrap.cc:492] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: No bootstrap required, opened a new log
I20260619 02:47:09.140483 26133 ts_tablet_manager.cc:1397] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:47:09.142762 26134 raft_consensus.cc:348] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.142935 26134 raft_consensus.cc:374] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:09.142974 26134 raft_consensus.cc:729] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523de0d105ca4746b4b95b6a3dd08caf, State: Initialized, Role: FOLLOWER
I20260619 02:47:09.143095 26134 consensus_queue.cc:260] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.142879 26133 raft_consensus.cc:348] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.143318 26133 raft_consensus.cc:374] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:09.143347 26134 ts_tablet_manager.cc:1428] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260619 02:47:09.143419 26133 raft_consensus.cc:729] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a0dbe516b7f4b0ab51ec8dbcbd9f8da, State: Initialized, Role: FOLLOWER
I20260619 02:47:09.143455 25966 heartbeater.cc:503] Master 127.12.145.126:34633 was elected leader, sending a full tablet report...
I20260619 02:47:09.143605 26133 consensus_queue.cc:260] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.143905 26133 ts_tablet_manager.cc:1428] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260619 02:47:09.144084 26100 heartbeater.cc:503] Master 127.12.145.126:34633 was elected leader, sending a full tablet report...
I20260619 02:47:09.147207 26135 tablet_bootstrap.cc:492] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e: No bootstrap required, opened a new log
I20260619 02:47:09.147271 26135 ts_tablet_manager.cc:1397] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260619 02:47:09.149613 26135 raft_consensus.cc:348] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.149780 26135 raft_consensus.cc:374] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:09.149817 26135 raft_consensus.cc:729] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2df03238e93421ca7f47fc6af356c0e, State: Initialized, Role: FOLLOWER
I20260619 02:47:09.149935 26135 consensus_queue.cc:260] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.150168 26135 ts_tablet_manager.cc:1428] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:47:09.150202 25832 heartbeater.cc:503] Master 127.12.145.126:34633 was elected leader, sending a full tablet report...
W20260619 02:47:09.158463 25967 tablet.cc:2369] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:09.196571 26139 raft_consensus.cc:482] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:09.196724 26139 raft_consensus.cc:504] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.197160 26139 leader_election.cc:288] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2df03238e93421ca7f47fc6af356c0e (127.12.145.65:45587), 8a0dbe516b7f4b0ab51ec8dbcbd9f8da (127.12.145.67:43131)
I20260619 02:47:09.201032 26132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.197498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:46297 (local address 127.12.145.67:43131)
0619 02:47:09.197540 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:09.197542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:09.197553 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:47:09.197667 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:09.197668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:09.197678 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:09.197708 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:09.197947 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.198747 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.200141 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.200650 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.200697 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.200705 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:09.200921 (+ 216us) server_negotiation.cc:299] Negotiation successful
0619 02:47:09.200969 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:47:09.201277 26143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.197312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:43131 (local address 127.12.145.66:46297)
0619 02:47:09.197492 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:09.197505 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:09.197570 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:09.197778 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:09.197779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:09.197781 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:09.197858 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.197860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.198872 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.198873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.200038 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.200040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.200780 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.200781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.200846 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.200850 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:09.201143 (+ 293us) client_negotiation.cc:240] Negotiation successful
0619 02:47:09.201184 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
I20260619 02:47:09.201735 26054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1141c609678e44f5a1fd8e52398f0377" candidate_uuid: "523de0d105ca4746b4b95b6a3dd08caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" is_pre_election: true
I20260619 02:47:09.201900 26054 raft_consensus.cc:2454] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523de0d105ca4746b4b95b6a3dd08caf in term 0.
I20260619 02:47:09.202154 25855 leader_election.cc:302] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523de0d105ca4746b4b95b6a3dd08caf, 8a0dbe516b7f4b0ab51ec8dbcbd9f8da; no voters:
I20260619 02:47:09.202281 26139 raft_consensus.cc:2781] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:47:09.202320 26139 raft_consensus.cc:482] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:47:09.202340 26139 raft_consensus.cc:3037] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:09.203240 26139 raft_consensus.cc:504] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.203372 26139 leader_election.cc:288] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [CANDIDATE]: Term 1 election: Requested vote from peers d2df03238e93421ca7f47fc6af356c0e (127.12.145.65:45587), 8a0dbe516b7f4b0ab51ec8dbcbd9f8da (127.12.145.67:43131)
I20260619 02:47:09.203624 26054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1141c609678e44f5a1fd8e52398f0377" candidate_uuid: "523de0d105ca4746b4b95b6a3dd08caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da"
I20260619 02:47:09.203699 26054 raft_consensus.cc:3037] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:09.204525 26054 raft_consensus.cc:2454] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523de0d105ca4746b4b95b6a3dd08caf in term 1.
I20260619 02:47:09.204699 25855 leader_election.cc:302] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523de0d105ca4746b4b95b6a3dd08caf, 8a0dbe516b7f4b0ab51ec8dbcbd9f8da; no voters:
I20260619 02:47:09.204773 26139 raft_consensus.cc:2781] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:09.204905 26139 raft_consensus.cc:686] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 1 LEADER]: Becoming Leader. State: Replica: 523de0d105ca4746b4b95b6a3dd08caf, State: Running, Role: LEADER
I20260619 02:47:09.204999 26139 consensus_queue.cc:237] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } }
I20260619 02:47:09.205757 25634 catalog_manager.cc:5495] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf reported cstate change: term changed from 0 to 1, leader changed from <none> to 523de0d105ca4746b4b95b6a3dd08caf (127.12.145.66). New cstate: current_term: 1 leader_uuid: "523de0d105ca4746b4b95b6a3dd08caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "523de0d105ca4746b4b95b6a3dd08caf" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45635 } health_report { overall_health: HEALTHY } } }
I20260619 02:47:09.206456 26144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.197650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45587 (local address 127.12.145.66:38959)
0619 02:47:09.197964 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:09.197974 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:09.198050 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:09.198263 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:09.198264 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:09.198265 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:09.198331 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.198332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.199311 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.199312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.200482 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:09.200485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.206157 (+ 5672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.206158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:09.206233 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.206237 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:09.206326 (+ 89us) client_negotiation.cc:240] Negotiation successful
0619 02:47:09.206362 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":72,"threads_started":1}
I20260619 02:47:09.206508 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.197804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:38959 (local address 127.12.145.65:45587)
0619 02:47:09.197843 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:09.197845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:09.198025 (+ 180us) server_negotiation.cc:407] Connection header received
0619 02:47:09.198151 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:09.198152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:09.198161 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:09.198188 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:09.198400 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.199131 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.200584 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.201175 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.201232 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.201240 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:09.206345 (+ 5105us) server_negotiation.cc:299] Negotiation successful
0619 02:47:09.206423 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:47:09.206808 25783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1141c609678e44f5a1fd8e52398f0377" candidate_uuid: "523de0d105ca4746b4b95b6a3dd08caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2df03238e93421ca7f47fc6af356c0e" is_pre_election: true
I20260619 02:47:09.206969 25783 raft_consensus.cc:2454] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 523de0d105ca4746b4b95b6a3dd08caf in term 0.
I20260619 02:47:09.207103 25784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1141c609678e44f5a1fd8e52398f0377" candidate_uuid: "523de0d105ca4746b4b95b6a3dd08caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2df03238e93421ca7f47fc6af356c0e"
I20260619 02:47:09.207175 25784 raft_consensus.cc:3037] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:09.207973 25784 raft_consensus.cc:2454] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 523de0d105ca4746b4b95b6a3dd08caf in term 1.
Jun 19 02:47:09 dist-test-slave-fbl4 krb5kdc[24638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837228, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for HTTP/127.12.145.84@KRBTEST.COM
I20260619 02:47:09.219904 26131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.213811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36420 (local address 127.12.145.66:45635)
0619 02:47:09.213873 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:09.213875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:09.213883 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:47:09.213912 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:09.213913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:09.213930 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:09.214014 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:47:09.214178 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.214910 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.215994 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:09.216279 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:09.216346 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:09.219296 (+ 2950us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:47:09.219421 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:47:09.219517 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:09.219815 (+ 298us) server_negotiation.cc:299] Negotiation successful
0619 02:47:09.219835 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:47:09.223811 26054 raft_consensus.cc:1261] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 1 FOLLOWER]: Refusing update from remote peer 523de0d105ca4746b4b95b6a3dd08caf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:09.224192 26145 consensus_queue.cc:1035] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a0dbe516b7f4b0ab51ec8dbcbd9f8da" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:09.226462 25784 raft_consensus.cc:1261] T 1141c609678e44f5a1fd8e52398f0377 P d2df03238e93421ca7f47fc6af356c0e [term 1 FOLLOWER]: Refusing update from remote peer 523de0d105ca4746b4b95b6a3dd08caf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:09.226751 26139 consensus_queue.cc:1035] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2df03238e93421ca7f47fc6af356c0e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:09.227566 26148 mvcc.cc:205] Tried to move back new op lower bound from 7298405290897829888 to 7298405290824122368. Current Snapshot: MvccSnapshot[applied={T|T < 7298405290897829888}]
I20260619 02:47:09.228138 26149 mvcc.cc:205] Tried to move back new op lower bound from 7298405290897829888 to 7298405290824122368. Current Snapshot: MvccSnapshot[applied={T|T < 7298405290897829888}]
I20260619 02:47:09.228609 26152 mvcc.cc:205] Tried to move back new op lower bound from 7298405290897829888 to 7298405290824122368. Current Snapshot: MvccSnapshot[applied={T|T < 7298405290897829888}]
I20260619 02:47:09.231653 25634 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:09.231736 25634 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:09.232456 25634 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c62894309464d7f8566c6ed52db3d4e: Sending DeleteTablet for 3 replicas of tablet 1141c609678e44f5a1fd8e52398f0377
I20260619 02:47:09.232869 26018 tablet_service.cc:1514] Processing DeleteTablet for tablet 1141c609678e44f5a1fd8e52398f0377 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:09 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:54500
I20260619 02:47:09.233075 25882 tablet_service.cc:1514] Processing DeleteTablet for tablet 1141c609678e44f5a1fd8e52398f0377 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:09 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:36416
I20260619 02:47:09.233346 25766 tablet_service.cc:1514] Processing DeleteTablet for tablet 1141c609678e44f5a1fd8e52398f0377 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:09 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:45180
I20260619 02:47:09.233868 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25672
I20260619 02:47:09.240355 26158 tablet_replica.cc:330] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: stopping tablet replica
I20260619 02:47:09.240495 26158 raft_consensus.cc:2229] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:09.242231 26158 raft_consensus.cc:2258] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:09.244113 26158 ts_tablet_manager.cc:1905] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:09.247104 26159 tablet_replica.cc:330] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: stopping tablet replica
I20260619 02:47:09.250152 26159 raft_consensus.cc:2229] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:47:09.251263 26159 raft_consensus.cc:2258] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:09.251741 26159 ts_tablet_manager.cc:1905] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:09.253173 26159 ts_tablet_manager.cc:1918] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:09.253245 26159 log.cc:1196] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/1141c609678e44f5a1fd8e52398f0377
I20260619 02:47:09.253641 26158 ts_tablet_manager.cc:1918] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:09.253712 26158 log.cc:1196] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/1141c609678e44f5a1fd8e52398f0377
I20260619 02:47:09.253953 26158 ts_tablet_manager.cc:1939] T 1141c609678e44f5a1fd8e52398f0377 P 8a0dbe516b7f4b0ab51ec8dbcbd9f8da: Deleting consensus metadata
I20260619 02:47:09.254226 26159 ts_tablet_manager.cc:1939] T 1141c609678e44f5a1fd8e52398f0377 P 523de0d105ca4746b4b95b6a3dd08caf: Deleting consensus metadata
I20260619 02:47:09.254362 25620 catalog_manager.cc:4841] TS 8a0dbe516b7f4b0ab51ec8dbcbd9f8da (127.12.145.67:43131): tablet 1141c609678e44f5a1fd8e52398f0377 (table test-table [id=4a8e8c38c1bf4ab5b54d941ee8ac1c5f]) successfully deleted
I20260619 02:47:09.254664 25620 catalog_manager.cc:4841] TS 523de0d105ca4746b4b95b6a3dd08caf (127.12.145.66:45635): tablet 1141c609678e44f5a1fd8e52398f0377 (table test-table [id=4a8e8c38c1bf4ab5b54d941ee8ac1c5f]) successfully deleted
W20260619 02:47:09.264582 25621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:45587 (error 108)
I20260619 02:47:09.268766 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25836
I20260619 02:47:09.271708 26128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:09.271573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45587 (local address 127.0.0.1:45184)
0619 02:47:09.271629 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:09.271669 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:45587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260619 02:47:09.271821 25621 catalog_manager.cc:4584] TS d2df03238e93421ca7f47fc6af356c0e (127.12.145.65:45587): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1141c609678e44f5a1fd8e52398f0377: Network error: Client connection negotiation failed: client connection to 127.12.145.65:45587: connect: Connection refused (error 111)
I20260619 02:47:09.274086 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25969
I20260619 02:47:09.279914 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 25601
I20260619 02:47:09.288143 12869 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260619 02:47:09.632048 12869 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260619 02:47:09.632164 12869 mini_ranger.cc:66] Stopping Ranger...
I20260619 02:47:09.976001 12869 mini_ranger.cc:68] Stopped Ranger
2026-06-19 02:47:09.976 UTC [24668] LOG: received smart shutdown request
2026-06-19 02:47:09.980 UTC [24668] LOG: background worker "logical replication launcher" (PID 24677) exited with exit code 1
2026-06-19 02:47:09.980 UTC [24672] LOG: shutting down
2026-06-19 02:47:10.123 UTC [24668] LOG: database system is shut down
2026-06-19T02:47:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (46426 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:47:10 dist-test-slave-fbl4 krb5kdc[26171](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:47:10 dist-test-slave-fbl4 krb5kdc[26171](info): set up 2 sockets
Jun 19 02:47:10 dist-test-slave-fbl4 krb5kdc[26171](info): commencing operation
krb5kdc: starting...
W20260619 02:47:11.262444 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:47:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:47:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:47:11.377081 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:44605
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:44605,127.12.145.125:34749,127.12.145.124:34321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:11.458637 26184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:11.458846 26184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:11.458868 26184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:11.460041 26184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:11.460083 26184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:11.460096 26184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:11.460109 26184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:11.460165 26184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:11.461730 26184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:44605,127.12.145.125:34749,127.12.145.124:34321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:44605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:11.461980 26184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:11.462214 26184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:11.467052 26192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:11.467063 26190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:11.467092 26184 server_base.cc:1034] running on GCE node
W20260619 02:47:11.467090 26189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:11.467476 26184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:11.467780 26184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:11.468945 26184 hybrid_clock.cc:648] HybridClock initialized: now 1781837231468939 us; error 36 us; skew 500 ppm
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:11.471555 26184 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:11.471971 26184 webserver.cc:460] Webserver started at http://127.12.145.126:42821/ using document root <none> and password file <none>
I20260619 02:47:11.472208 26184 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:11.472275 26184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:11.472424 26184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:11.473459 26184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "a6fbe83b44c64334b65116887db36f43"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "bf7409a1b6f57d258614ebbe533d4f92"
server_key_iv: "83ff5df7141c50cf8e8d69008f878f4e"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.473824 26184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "a6fbe83b44c64334b65116887db36f43"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "bf7409a1b6f57d258614ebbe533d4f92"
server_key_iv: "83ff5df7141c50cf8e8d69008f878f4e"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.475180 26184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:47:11.475906 26199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:11.476073 26184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:47:11.476173 26184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "a6fbe83b44c64334b65116887db36f43"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "bf7409a1b6f57d258614ebbe533d4f92"
server_key_iv: "83ff5df7141c50cf8e8d69008f878f4e"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.476245 26184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:11.501215 26184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:11.503567 26184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:11.503729 26184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:11.507485 26184 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:44605
I20260619 02:47:11.507519 26251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:44605 every 8 connection(s)
I20260619 02:47:11.507882 26184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:11.508780 26252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:11.510274 26252 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:47:11.511984 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26184
I20260619 02:47:11.512095 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:47:11.512308 12869 external_mini_cluster.cc:1428] Setting key 955e238b9cdf570fac3ec194791765b8
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.125@KRBTEST.COM; defaulting to no policy
I20260619 02:47:11.519819 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.510981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44605 (local address 127.0.0.1:50868)
0619 02:47:11.511204 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.511231 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.511668 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.511926 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.511929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.512268 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.512466 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.512476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.513477 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.513505 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.514176 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.514178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.514744 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.514745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.514811 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.515291 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.515299 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.516619 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.518311 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.518317 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.518319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.518508 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.518786 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.518786 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.518787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.518868 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.519216 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.519220 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.519281 (+ 61us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.519387 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.519614 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":83,"thread_start_us":89,"threads_started":1}
I20260619 02:47:11.519822 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.511011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.12.145.126:44605)
0619 02:47:11.511153 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.511160 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.511326 (+ 166us) server_negotiation.cc:407] Connection header received
0619 02:47:11.511796 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.511798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.511814 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.511922 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.512575 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.513349 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.514269 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.514652 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.514766 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.516722 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.516728 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.516729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.516735 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.518214 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.518626 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.518629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.518629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.518710 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.518932 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.518933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.518933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.519144 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.519235 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.519412 (+ 177us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.519568 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":109,"thread_start_us":70,"threads_started":1}
I20260619 02:47:11.520530 26252 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:47:11.520895 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.520792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48446)
0619 02:47:11.520835 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.520875 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260619 02:47:11.521044 26200 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
I20260619 02:47:11.521414 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.521333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48450)
0619 02:47:11.521377 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.521399 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:47:11.521565 26252 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:34749: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab.
Entry for principal kudu/127.12.145.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab.
I20260619 02:47:11.535735 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:34749
--webserver_interface=127.12.145.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab
--principal=kudu/127.12.145.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:44605,127.12.145.125:34749,127.12.145.124:34321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:11.570788 26252 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } attempt: 1
I20260619 02:47:11.571280 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.571144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48454)
0619 02:47:11.571214 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.571251 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260619 02:47:11.571700 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.571615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48464)
0619 02:47:11.571660 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.571685 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:47:11.571815 26252 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:34749: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
W20260619 02:47:11.615182 26259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:11.615370 26259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:11.615391 26259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:11.616448 26259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:11.616484 26259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:11.616513 26259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:11.616524 26259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:11.616535 26259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:11.617926 26259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:44605,127.12.145.125:34749,127.12.145.124:34321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab
--principal=kudu/127.12.145.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:34749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:11.618110 26259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:11.618263 26259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:11.622874 26265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:11.622854 26267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:11.622884 26259 server_base.cc:1034] running on GCE node
W20260619 02:47:11.622854 26264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:11.623330 26259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:11.623584 26259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:11.624747 26259 hybrid_clock.cc:648] HybridClock initialized: now 1781837231624730 us; error 29 us; skew 500 ppm
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:11.627229 26259 init.cc:377] Logged in from keytab as kudu/127.12.145.125@KRBTEST.COM (short username kudu)
I20260619 02:47:11.627650 26259 webserver.cc:460] Webserver started at http://127.12.145.125:44809/ using document root <none> and password file <none>
I20260619 02:47:11.627861 26259 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:11.627931 26259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:11.628068 26259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:11.629042 26259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data/instance:
uuid: "054d031b764a4df183240d1ec7de6c3d"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "65e67d4938dc271fa37e68a4c4674607"
server_key_iv: "9724678172ac77441f263994aa0ee27e"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.629383 26259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/wal/instance:
uuid: "054d031b764a4df183240d1ec7de6c3d"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "65e67d4938dc271fa37e68a4c4674607"
server_key_iv: "9724678172ac77441f263994aa0ee27e"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.630770 26259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:47:11.631431 26274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:11.631599 26259 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:11.631690 26259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/wal
uuid: "054d031b764a4df183240d1ec7de6c3d"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "65e67d4938dc271fa37e68a4c4674607"
server_key_iv: "9724678172ac77441f263994aa0ee27e"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.631773 26259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:11.639976 26252 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } attempt: 2
I20260619 02:47:11.640367 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.640238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48480)
0619 02:47:11.640294 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.640332 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260619 02:47:11.640666 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.640590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48488)
0619 02:47:11.640626 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.640650 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260619 02:47:11.640786 26252 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:34749: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34749: connect: Connection refused (error 111)
I20260619 02:47:11.648638 26259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:11.650629 26259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:11.650776 26259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:11.654620 26259 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.125:34749
I20260619 02:47:11.654649 26326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.125:34749 every 8 connection(s)
I20260619 02:47:11.655004 26259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
I20260619 02:47:11.655810 26327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:11.657246 26327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:47:11.660073 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26259
I20260619 02:47:11.660200 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-1/wal/instance
I20260619 02:47:11.660408 12869 external_mini_cluster.cc:1428] Setting key 4fcc576312f60d358954428eee4d6c2d
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:11.666738 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.657885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50878 (local address 127.12.145.126:44605)
0619 02:47:11.657947 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.657949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.658147 (+ 198us) server_negotiation.cc:407] Connection header received
0619 02:47:11.658592 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.658593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.658607 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.658668 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.659258 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.659722 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.660834 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.661193 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.661270 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.663557 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.663558 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.663559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.663566 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.665276 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.665715 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.665716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.665717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.665784 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.666040 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.666041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.666042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.666184 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.666263 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.666489 (+ 226us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.666632 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:47:11.666834 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.657849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44605 (local address 127.0.0.1:50878)
0619 02:47:11.658019 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.658059 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.658477 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.658723 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.658726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.658972 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.659152 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.659155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.659810 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.659811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.660751 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.660753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.661278 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.661279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.661376 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.661892 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.661900 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.663470 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.665385 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.665391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.665393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.665639 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.665856 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.665865 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.665866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.665970 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.666255 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.666259 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.666363 (+ 104us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.666469 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.666650 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260619 02:47:11.667546 26327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.145.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.124@KRBTEST.COM" created.
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:47:11.675042 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.667961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48490 (local address 127.12.145.125:34749)
0619 02:47:11.668114 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.668118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.668132 (+ 14us) server_negotiation.cc:407] Connection header received
0619 02:47:11.668147 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.668149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.668159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.668237 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.668534 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.669221 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.669899 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.670173 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.670251 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.672021 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.672029 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.672029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.672037 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.673617 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.674034 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.674037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.674037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.674095 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.674329 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.674330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.674330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.674468 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.674639 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.674783 (+ 144us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.674918 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260619 02:47:11.675056 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.667880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48490)
0619 02:47:11.667945 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.667953 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.667991 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.668238 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.668238 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.668388 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.668425 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.668426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.669310 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.669311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.669807 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.669808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.670259 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.670260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.670349 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.670774 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.670778 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.671937 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.673703 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.673704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.673705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.673942 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.674166 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.674167 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.674167 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.674238 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.674612 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.674613 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.674671 (+ 58us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.674758 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.674869 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260619 02:47:11.675799 26327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:47:11.676155 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.676016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47538)
0619 02:47:11.676071 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.676128 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260619 02:47:11.676304 26278 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
I20260619 02:47:11.676738 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.676620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47552)
0619 02:47:11.676677 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.676709 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260619 02:47:11.676906 26327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:34321: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab.
Entry for principal kudu/127.12.145.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab.
I20260619 02:47:11.685758 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:34321
--webserver_interface=127.12.145.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab
--principal=kudu/127.12.145.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:44605,127.12.145.125:34749,127.12.145.124:34321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:11.726156 26327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } attempt: 1
I20260619 02:47:11.726713 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.726543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47560)
0619 02:47:11.726639 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.726681 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260619 02:47:11.727118 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.727028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47572)
0619 02:47:11.727073 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.727100 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 02:47:11.727226 26327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:34321: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
I20260619 02:47:11.732079 26252 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } attempt: 3
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:47:11.739041 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.732426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48500 (local address 127.12.145.125:34749)
0619 02:47:11.732508 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.732511 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.732520 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:11.732546 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.732547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.732559 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.732628 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.732932 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.733434 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.734206 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.734413 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.734505 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.736367 (+ 1862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.736368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.736369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.736376 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.737848 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.738218 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.738219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.738220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.738274 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.738467 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.738468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.738468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.738636 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.738708 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.738853 (+ 145us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.738922 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:47:11.739050 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.732356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48500)
0619 02:47:11.732410 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.732421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.732490 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.732633 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.732634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.732786 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.732847 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.732849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.733537 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.733538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.734111 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.734113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.734505 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.734506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.734604 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.735129 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.735135 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.736281 (+ 1146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.737955 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.737957 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.737957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.738140 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.738346 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.738347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.738347 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.738405 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.738700 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.738701 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.738746 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.738831 (+ 85us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.738921 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260619 02:47:11.739391 26252 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:47:11.739730 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.739636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47586)
0619 02:47:11.739682 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.739707 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260619 02:47:11.740042 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.739955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47596)
0619 02:47:11.740001 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.740022 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:47:11.740154 26252 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:34321: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
W20260619 02:47:11.767285 26334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:11.767513 26334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:11.767537 26334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:11.768651 26334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:11.768692 26334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:11.768705 26334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:11.768756 26334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:11.768774 26334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:11.770170 26334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:44605,127.12.145.125:34749,127.12.145.124:34321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab
--principal=kudu/127.12.145.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:34321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:11.770411 26334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:11.770650 26334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 02:47:11.771282 26252 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } attempt: 1
I20260619 02:47:11.771678 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.771554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47606)
0619 02:47:11.771620 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.771653 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260619 02:47:11.772053 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.771967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47612)
0619 02:47:11.772012 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.772037 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:47:11.772168 26252 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:34321: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
W20260619 02:47:11.775429 26339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:11.775436 26342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:11.775440 26340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:11.775624 26334 server_base.cc:1034] running on GCE node
I20260619 02:47:11.775878 26334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:11.776158 26334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:11.777307 26334 hybrid_clock.cc:648] HybridClock initialized: now 1781837231777294 us; error 26 us; skew 500 ppm
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:11.779877 26334 init.cc:377] Logged in from keytab as kudu/127.12.145.124@KRBTEST.COM (short username kudu)
I20260619 02:47:11.780321 26334 webserver.cc:460] Webserver started at http://127.12.145.124:34107/ using document root <none> and password file <none>
I20260619 02:47:11.780505 26334 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:11.780547 26334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:11.780632 26334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:11.781602 26334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data/instance:
uuid: "abf3682a4f2c4437a8f6cea4df51ac10"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "1dfe4ab42c6d47a7c8dcf8d7b7f894fa"
server_key_iv: "15b820dbf6f3f1fd376b8a1fc8b1a424"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.781890 26334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/wal/instance:
uuid: "abf3682a4f2c4437a8f6cea4df51ac10"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "1dfe4ab42c6d47a7c8dcf8d7b7f894fa"
server_key_iv: "15b820dbf6f3f1fd376b8a1fc8b1a424"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.783202 26334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260619 02:47:11.783907 26349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:11.784086 26334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:47:11.784205 26334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/wal
uuid: "abf3682a4f2c4437a8f6cea4df51ac10"
format_stamp: "Formatted at 2026-06-19 02:47:11 on dist-test-slave-fbl4"
server_key: "1dfe4ab42c6d47a7c8dcf8d7b7f894fa"
server_key_iv: "15b820dbf6f3f1fd376b8a1fc8b1a424"
server_key_version: "encryptionkey@0"
I20260619 02:47:11.784281 26334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:11.795364 26327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } attempt: 2
I20260619 02:47:11.795778 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.795635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47616)
0619 02:47:11.795700 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.795741 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260619 02:47:11.796139 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.796048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47620)
0619 02:47:11.796093 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.796119 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 02:47:11.796250 26327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:34321: Network error: Client connection negotiation failed: client connection to 127.12.145.124:34321: connect: Connection refused (error 111)
I20260619 02:47:11.806883 26334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:11.808866 26334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:11.808985 26334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:11.813059 26334 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.124:34321
I20260619 02:47:11.813145 26401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.124:34321 every 8 connection(s)
I20260619 02:47:11.813489 26334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
I20260619 02:47:11.814375 26402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:11.816196 26402 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:47:11.820317 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26334
I20260619 02:47:11.820443 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781837054956172-12869-0/minicluster-data/master-2/wal/instance
I20260619 02:47:11.820703 12869 external_mini_cluster.cc:1428] Setting key 37d4609e06476d8de2f6d2fd9dd2bed0
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:11.825362 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.816947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50884 (local address 127.12.145.126:44605)
0619 02:47:11.817034 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.817036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.817236 (+ 200us) server_negotiation.cc:407] Connection header received
0619 02:47:11.817683 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.817684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.817693 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.817751 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.818368 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.818926 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.819973 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.820191 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.820266 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.822504 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.822506 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.822506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.822513 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.823952 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.824325 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.824326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.824326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.824390 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.824689 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.824690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.824690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.824830 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.824898 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.825229 (+ 331us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.825294 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 02:47:11.825636 26404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.816914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44605 (local address 127.0.0.1:50884)
0619 02:47:11.817104 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.817145 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.817598 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.817822 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.817825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.818064 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.818257 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.818261 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.819006 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.819007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.819900 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.819903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.820272 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.820272 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.820373 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.820990 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.821001 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.822413 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.824032 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.824038 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.824039 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.824250 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.824459 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.824460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.824460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.824606 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.824893 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.824913 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.825086 (+ 173us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.825207 (+ 121us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.825377 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260619 02:47:11.826179 26402 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
I20260619 02:47:11.830127 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.821113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47628 (local address 127.12.145.124:34321)
0619 02:47:11.821285 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.821291 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.821310 (+ 19us) server_negotiation.cc:407] Connection header received
0619 02:47:11.821378 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.821381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.821403 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.821495 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.822096 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.823048 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.823928 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.824330 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.824400 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.827107 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.827115 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.827115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.827122 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.828864 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.829267 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.829269 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.829270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.829345 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.829543 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.829544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.829545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.829719 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.829857 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.829941 (+ 84us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.830008 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":83,"threads_started":1}
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:47:11.834039 26404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.826435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34749 (local address 127.0.0.1:48512)
0619 02:47:11.826494 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.826506 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.826571 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.826734 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.826735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.827063 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.827113 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.827114 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.828011 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.828012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.828886 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.828888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.829355 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.829356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.829437 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.829775 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.829780 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.831148 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.832776 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.832777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.832777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.832940 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.833142 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.833142 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.833143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.833197 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.833744 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.833745 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.833788 (+ 43us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.833864 (+ 76us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.833955 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260619 02:47:11.834147 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.826523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48512 (local address 127.12.145.125:34749)
0619 02:47:11.826608 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.826610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.826619 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:11.826644 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.826645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.826656 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.826718 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.827231 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.827917 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.828965 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.829280 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.829339 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.831234 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.831237 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.831237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.831245 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.832701 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.833013 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.833015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.833015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.833071 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.833254 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.833254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.833255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.833376 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.833468 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.833911 (+ 443us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.833989 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 02:47:11.834487 26402 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:11.838734 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.830990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.12.145.126:44605)
0619 02:47:11.831031 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.831033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.831041 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:47:11.831111 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.831112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.831121 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.831176 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.831732 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.832460 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.833089 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.833386 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.833489 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.835836 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.835837 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.835837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.835843 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.837483 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.837881 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.837882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.837882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.837935 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.838174 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.838175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.838175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.838301 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.838483 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.838527 (+ 44us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.838633 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
I20260619 02:47:11.842417 26404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.834781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47644)
0619 02:47:11.834809 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.834819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.834856 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.835534 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.835535 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.835676 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.835704 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.835705 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.836474 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.836475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.837231 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.837234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.837674 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.837675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.837714 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.838069 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.838077 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.839695 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.841357 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.841357 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.841358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.841535 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.841752 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.841753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.841754 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.841828 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.842095 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.842095 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.842143 (+ 48us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.842196 (+ 53us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.842305 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260619 02:47:11.842505 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.834829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47644 (local address 127.12.145.124:34321)
0619 02:47:11.834889 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.834891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.834900 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:11.834919 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.834920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.834932 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.834988 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.835785 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.836349 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.837321 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.837591 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.837667 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.839783 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.839785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.839785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.839792 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.841252 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.841611 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.841612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.841612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.841674 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.841906 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.841906 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.841906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.841998 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.842092 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.842252 (+ 160us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.842361 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":39}
I20260619 02:47:11.844161 26402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10: Bootstrap starting.
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:47:11.845274 26402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:11.845633 26402 log.cc:824] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:11.846390 26402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10: No bootstrap required, opened a new log
I20260619 02:47:11.847374 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.839399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.12.145.125:34749)
0619 02:47:11.839439 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.839441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.839449 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:47:11.839469 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.839469 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.839500 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.839565 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.840236 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.840821 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.841681 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.841985 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.842033 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.844821 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.844822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.844822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.844828 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.846306 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.846708 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.846709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.846709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.846761 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.846970 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.846971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.846971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.847063 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.847185 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.847260 (+ 75us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.847317 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:47:11.847450 26252 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } attempt: 2
I20260619 02:47:11.849098 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:47:11.849241 26402 raft_consensus.cc:348] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.849347 26402 raft_consensus.cc:374] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:11.849367 26402 raft_consensus.cc:729] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf3682a4f2c4437a8f6cea4df51ac10, State: Initialized, Role: FOLLOWER
I20260619 02:47:11.849483 26402 consensus_queue.cc:260] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.849715 26408 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.849777 26408 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:47:11.849779 26402 sys_catalog.cc:564] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: configured and running, proceeding with master startup.
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
W20260619 02:47:11.852138 26424 catalog_manager.cc:1558] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:47:11.852658 26424 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:47:11.852070 26334 master_runner.cc:186] Error getting master registration for 127.12.145.126:44605: OK, instance_id { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" instance_seqno: 1781837231506348 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 02:47:11.855314 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.847876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47656 (local address 127.12.145.124:34321)
0619 02:47:11.847932 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.847934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.847943 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:11.847962 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.847963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.847972 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.848034 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.848346 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.849024 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.849989 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.850281 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.850351 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.852499 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.852500 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.852500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.852507 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.853955 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.854301 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.854302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.854303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.854355 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.854777 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.854778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.854778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.854920 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.855004 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.855160 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.855228 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:47:11.855317 26254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.847685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47656)
0619 02:47:11.847739 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.847749 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.847786 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.848055 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.848056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.848227 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.848270 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.848272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.849136 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.849137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.849887 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.849889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.850418 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.850419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.850482 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.850935 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.850962 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.852392 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.854057 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.854058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.854058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.854226 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.854427 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.854428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.854428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.854484 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.854999 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.855000 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.855047 (+ 47us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.855136 (+ 89us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.855227 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260619 02:47:11.855383 26334 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 02:47:11.857152 26252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: Bootstrap starting.
I20260619 02:47:11.857952 26252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:11.858278 26252 log.cc:824] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:11.858796 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.850677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48524 (local address 127.12.145.125:34749)
0619 02:47:11.850711 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.850712 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.851175 (+ 463us) server_negotiation.cc:407] Connection header received
0619 02:47:11.851377 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.851378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.851389 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.851419 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.852186 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.852848 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.853880 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.854212 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.854250 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.855783 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.855785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.855785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.855791 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.857369 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.857836 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.857838 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.857838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.857909 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.858145 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.858146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.858147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.858279 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.858350 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.858598 (+ 248us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.858688 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260619 02:47:11.860375 26252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: No bootstrap required, opened a new log
I20260619 02:47:11.862499 26252 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.862771 26252 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:11.862818 26252 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6fbe83b44c64334b65116887db36f43, State: Initialized, Role: FOLLOWER
I20260619 02:47:11.862950 26252 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.863273 26252 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:11.864078 26255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.850924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50898 (local address 127.12.145.126:44605)
0619 02:47:11.850984 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.850986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.854668 (+ 3682us) server_negotiation.cc:407] Connection header received
0619 02:47:11.854776 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.854777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.854786 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.854812 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.857696 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.858397 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.859470 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.859746 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.859785 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.861181 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.861183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.861183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.861189 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.862745 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.863139 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.863140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.863141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.863192 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.863398 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.863399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.863399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.863531 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.863598 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.863914 (+ 316us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.863996 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260619 02:47:11.864687 26430 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.864820 26430 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [sys.catalog]: This master's current role is: FOLLOWER
W20260619 02:47:11.865685 26441 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:47:11.865793 26441 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:47:11.867286 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.851524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47670 (local address 127.12.145.124:34321)
0619 02:47:11.855382 (+ 3858us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.855384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.858707 (+ 3323us) server_negotiation.cc:407] Connection header received
0619 02:47:11.859368 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.859369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.859380 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.859408 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.860005 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.860877 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.862335 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.862632 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.862676 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.864160 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.864161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.864162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.864168 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.865865 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.866268 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.866270 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.866270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.866324 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.866671 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.866672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.866673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.866801 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.866861 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.867105 (+ 244us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.867173 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3845,"thread_start_us":62,"threads_started":1}
I20260619 02:47:11.866086 26184 master_runner.cc:186] Error getting master registration for 127.12.145.125:34749: OK, instance_id { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" instance_seqno: 1781837231653528 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 02:47:11.868543 26184 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 02:47:11.876726 26408 raft_consensus.cc:482] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:11.876835 26408 raft_consensus.cc:504] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.877107 26408 leader_election.cc:288] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6fbe83b44c64334b65116887db36f43 (127.12.145.126:44605), 054d031b764a4df183240d1ec7de6c3d (127.12.145.125:34749)
I20260619 02:47:11.877338 26226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6fbe83b44c64334b65116887db36f43" is_pre_election: true
I20260619 02:47:11.877499 26226 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abf3682a4f2c4437a8f6cea4df51ac10 in term 0.
I20260619 02:47:11.877739 26352 leader_election.cc:302] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6fbe83b44c64334b65116887db36f43, abf3682a4f2c4437a8f6cea4df51ac10; no voters:
I20260619 02:47:11.877856 26408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:47:11.877905 26408 raft_consensus.cc:482] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:47:11.877934 26408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:11.878931 26408 raft_consensus.cc:504] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.879058 26408 leader_election.cc:288] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [CANDIDATE]: Term 1 election: Requested vote from peers a6fbe83b44c64334b65116887db36f43 (127.12.145.126:44605), 054d031b764a4df183240d1ec7de6c3d (127.12.145.125:34749)
I20260619 02:47:11.879572 26226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6fbe83b44c64334b65116887db36f43"
I20260619 02:47:11.879640 26226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:11.880488 26226 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abf3682a4f2c4437a8f6cea4df51ac10 in term 1.
I20260619 02:47:11.880673 26352 leader_election.cc:302] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6fbe83b44c64334b65116887db36f43, abf3682a4f2c4437a8f6cea4df51ac10; no voters:
I20260619 02:47:11.880753 26408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:11.880908 26408 raft_consensus.cc:686] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [term 1 LEADER]: Becoming Leader. State: Replica: abf3682a4f2c4437a8f6cea4df51ac10, State: Running, Role: LEADER
I20260619 02:47:11.881009 26408 consensus_queue.cc:237] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.881403 26443 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abf3682a4f2c4437a8f6cea4df51ac10. Latest consensus state: current_term: 1 leader_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.881673 26443 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:11.882009 26445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:11.882189 26445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:11.883638 26226 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [term 1 FOLLOWER]: Refusing update from remote peer abf3682a4f2c4437a8f6cea4df51ac10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:11.883942 26443 consensus_queue.cc:1035] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:11.885203 26430 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abf3682a4f2c4437a8f6cea4df51ac10. Latest consensus state: current_term: 1 leader_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.885286 26430 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:47:11.887379 26327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } attempt: 3
Jun 19 02:47:11 dist-test-slave-fbl4 krb5kdc[26171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837231, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
I20260619 02:47:11.895656 26329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.887632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:34321 (local address 127.0.0.1:47678)
0619 02:47:11.887677 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:11.887689 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:11.887726 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:11.887861 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:11.887863 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:11.888024 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:11.888062 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.888064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.888956 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.888957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.889794 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:11.889796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.890272 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.890273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:11.890329 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.890854 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:11.890860 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:11.892343 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:11.894198 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.894200 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.894200 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.894427 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.895009 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:11.895010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:11.895010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:11.895076 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:11.895311 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:11.895312 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:11.895363 (+ 51us) client_negotiation.cc:769] Sending connection context
0619 02:47:11.895446 (+ 83us) client_negotiation.cc:240] Negotiation successful
0619 02:47:11.895547 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260619 02:47:11.896199 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:11.887656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47678 (local address 127.12.145.124:34321)
0619 02:47:11.887712 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:11.887714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:11.887723 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:11.887776 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:11.887777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:11.887788 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:11.887854 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:11.888139 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.888873 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.889877 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:11.890166 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:11.890222 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:11.892420 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:11.892421 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:11.892421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:11.892428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:11.894100 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.894841 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.894842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.894842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.894921 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:11.895138 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:11.895139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:11.895140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:11.895245 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:11.895319 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:11.896027 (+ 708us) server_negotiation.cc:299] Negotiation successful
0619 02:47:11.896105 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:47:11.897734 26327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: Bootstrap starting.
I20260619 02:47:11.898406 26327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:11.898738 26327 log.cc:824] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:11.899398 26327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: No bootstrap required, opened a new log
I20260619 02:47:11.900693 26327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.900815 26327 raft_consensus.cc:374] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:11.900857 26327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054d031b764a4df183240d1ec7de6c3d, State: Initialized, Role: FOLLOWER
I20260619 02:47:11.900983 26327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } }
I20260619 02:47:11.901219 26450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.901278 26327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:11.901482 26301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054d031b764a4df183240d1ec7de6c3d" is_pre_election: true
W20260619 02:47:11.901373 26280 tablet.cc:2369] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:11.901402 26300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054d031b764a4df183240d1ec7de6c3d"
I20260619 02:47:11.901372 26299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:11.903048 26450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:47:11.903445 26443 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.903530 26443 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:11.904000 26447 mvcc.cc:205] Tried to move back new op lower bound from 7298405301793214464 to 7298405301785272320. Current Snapshot: MvccSnapshot[applied={T|T < 7298405301793214464}]
I20260619 02:47:11.904110 26430 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.904170 26430 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:47:11.904448 26299 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [term 1 FOLLOWER]: Refusing update from remote peer abf3682a4f2c4437a8f6cea4df51ac10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:11.904958 26408 consensus_queue.cc:1035] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:11.905198 26445 catalog_manager.cc:1347] Generated new cluster ID: f2e4da4b45024052bb41ca015d633845
I20260619 02:47:11.905243 26445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:47:11.910877 26450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader abf3682a4f2c4437a8f6cea4df51ac10. Latest consensus state: current_term: 1 leader_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.911470 26450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:47:11.911563 26450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.911650 26450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d [sys.catalog]: This master's current role is: FOLLOWER
W20260619 02:47:11.912122 26463 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:47:11.912199 26463 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:47:11.912979 26464 mvcc.cc:205] Tried to move back new op lower bound from 7298405301793214464 to 7298405301785272320. Current Snapshot: MvccSnapshot[applied={T|T < 7298405301793214464}]
I20260619 02:47:11.919695 26408 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6fbe83b44c64334b65116887db36f43" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 44605 } } peers { permanent_uuid: "054d031b764a4df183240d1ec7de6c3d" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34749 } } peers { permanent_uuid: "abf3682a4f2c4437a8f6cea4df51ac10" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 34321 } } }
I20260619 02:47:11.919790 26408 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:11.921800 26445 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:47:11.922541 26445 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:11.933722 26445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10: Generated new TSK 0
I20260619 02:47:11.934763 26445 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:47:12.866325 26441 catalog_manager.cc:1259] Loaded cluster ID: f2e4da4b45024052bb41ca015d633845
I20260619 02:47:12.866397 26441 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: loading cluster ID for follower catalog manager: success
I20260619 02:47:12.867272 26441 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: acquiring CA information for follower catalog manager: success
I20260619 02:47:12.867602 26441 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a6fbe83b44c64334b65116887db36f43: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 02:47:12.912626 26463 catalog_manager.cc:1259] Loaded cluster ID: f2e4da4b45024052bb41ca015d633845
I20260619 02:47:12.912698 26463 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: loading cluster ID for follower catalog manager: success
I20260619 02:47:12.913529 26463 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: acquiring CA information for follower catalog manager: success
I20260619 02:47:12.913836 26463 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 054d031b764a4df183240d1ec7de6c3d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 02:47:13.007263 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26184
I20260619 02:47:13.012269 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26259
I20260619 02:47:13.012427 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:13.012200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44605 (local address 127.0.0.1:50900)
0619 02:47:13.012320 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:13.012375 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":75,"threads_started":1}
W20260619 02:47:13.013139 26352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44605: connect: Connection refused (error 111)
I20260619 02:47:13.013590 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:13.013484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:44605 (local address 127.0.0.1:50906)
0619 02:47:13.013531 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:13.013561 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260619 02:47:13.013710 26352 consensus_peers.cc:487] T 00000000000000000000000000000000 P abf3682a4f2c4437a8f6cea4df51ac10 -> Peer a6fbe83b44c64334b65116887db36f43 (127.12.145.126:44605): Couldn't send request to peer a6fbe83b44c64334b65116887db36f43. Status: Network error: Client connection negotiation failed: client connection to 127.12.145.126:44605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 02:47:13.017089 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26334
2026-06-19T02:47:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2788 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:47:13 dist-test-slave-fbl4 krb5kdc[26479](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:47:13 dist-test-slave-fbl4 krb5kdc[26479](info): set up 2 sockets
Jun 19 02:47:13 dist-test-slave-fbl4 krb5kdc[26479](info): commencing operation
krb5kdc: starting...
W20260619 02:47:14.050668 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:47:14 dist-test-slave-fbl4 krb5kdc[26479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837234, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:47:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:47:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:47:14.166865 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36933
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:36933
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:14.246294 26492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:14.246537 26492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:14.246587 26492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:14.247706 26492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:14.247774 26492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:14.247797 26492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:14.247829 26492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:14.247870 26492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:14.249305 26492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:36933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:14.249583 26492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:14.249800 26492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:14.254576 26498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:14.254571 26497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:14.254570 26500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:14.254755 26492 server_base.cc:1034] running on GCE node
I20260619 02:47:14.255010 26492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:14.255316 26492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:14.256507 26492 hybrid_clock.cc:648] HybridClock initialized: now 1781837234256477 us; error 43 us; skew 500 ppm
Jun 19 02:47:14 dist-test-slave-fbl4 krb5kdc[26479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837234, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:14.258996 26492 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:14.259485 26492 webserver.cc:460] Webserver started at http://127.12.145.126:43929/ using document root <none> and password file <none>
I20260619 02:47:14.259727 26492 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:14.259796 26492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:14.259948 26492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:14.261029 26492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "25ed526d40c947a4a574ad1e84eefcd0"
format_stamp: "Formatted at 2026-06-19 02:47:14 on dist-test-slave-fbl4"
server_key: "df6caa91b2f641715f5b375d4aa769d6"
server_key_iv: "930ea345bf8579d21e12ec4d3ab311d1"
server_key_version: "encryptionkey@0"
I20260619 02:47:14.261390 26492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "25ed526d40c947a4a574ad1e84eefcd0"
format_stamp: "Formatted at 2026-06-19 02:47:14 on dist-test-slave-fbl4"
server_key: "df6caa91b2f641715f5b375d4aa769d6"
server_key_iv: "930ea345bf8579d21e12ec4d3ab311d1"
server_key_version: "encryptionkey@0"
I20260619 02:47:14.262809 26492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:47:14.263689 26507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:14.263891 26492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:14.264010 26492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "25ed526d40c947a4a574ad1e84eefcd0"
format_stamp: "Formatted at 2026-06-19 02:47:14 on dist-test-slave-fbl4"
server_key: "df6caa91b2f641715f5b375d4aa769d6"
server_key_iv: "930ea345bf8579d21e12ec4d3ab311d1"
server_key_version: "encryptionkey@0"
I20260619 02:47:14.264088 26492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:14.279891 26492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:14.281919 26492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:14.282094 26492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:14.286084 26492 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:36933
I20260619 02:47:14.286135 26559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:36933 every 8 connection(s)
I20260619 02:47:14.286491 26492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:14.287348 26560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:14.289590 26560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0: Bootstrap starting.
I20260619 02:47:14.290155 26560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:14.290453 26560 log.cc:824] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:14.291137 26560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0: No bootstrap required, opened a new log
I20260619 02:47:14.291131 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26492
I20260619 02:47:14.291255 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:47:14.291445 12869 external_mini_cluster.cc:1428] Setting key f54680bb98dc6b5b75711d77608d43fc
I20260619 02:47:14.293623 26560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ed526d40c947a4a574ad1e84eefcd0" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36933 } }
I20260619 02:47:14.293776 26560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:14.293821 26560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ed526d40c947a4a574ad1e84eefcd0, State: Initialized, Role: FOLLOWER
I20260619 02:47:14.293969 26560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ed526d40c947a4a574ad1e84eefcd0" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36933 } }
I20260619 02:47:14.294059 26560 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:14.294102 26560 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:14.294150 26560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:14.294731 26560 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ed526d40c947a4a574ad1e84eefcd0" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36933 } }
I20260619 02:47:14.294842 26560 leader_election.cc:302] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25ed526d40c947a4a574ad1e84eefcd0; no voters:
I20260619 02:47:14.295022 26560 leader_election.cc:288] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:47:14.295082 26565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:14.295220 26565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [term 1 LEADER]: Becoming Leader. State: Replica: 25ed526d40c947a4a574ad1e84eefcd0, State: Running, Role: LEADER
I20260619 02:47:14.295276 26560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:14.295302 26565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ed526d40c947a4a574ad1e84eefcd0" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36933 } }
I20260619 02:47:14.295753 26565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25ed526d40c947a4a574ad1e84eefcd0. Latest consensus state: current_term: 1 leader_uuid: "25ed526d40c947a4a574ad1e84eefcd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ed526d40c947a4a574ad1e84eefcd0" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36933 } } }
I20260619 02:47:14.295881 26565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:14.295763 26566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25ed526d40c947a4a574ad1e84eefcd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ed526d40c947a4a574ad1e84eefcd0" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36933 } } }
I20260619 02:47:14.296023 26566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:14.296749 26574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:14.297279 26574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:14.298919 26574 catalog_manager.cc:1347] Generated new cluster ID: 4acba5127b30461a99d56d3633efa3ea
I20260619 02:47:14.298965 26574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:47:14 dist-test-slave-fbl4 krb5kdc[26479](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837234, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:14.303201 26564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:14.291936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37004 (local address 127.12.145.126:36933)
0619 02:47:14.292100 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:14.292107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:14.292134 (+ 27us) server_negotiation.cc:407] Connection header received
0619 02:47:14.292548 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:14.292555 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:14.292613 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:14.292725 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:14.293516 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:14.294807 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:14.295993 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:14.296662 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:14.296774 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:14.299528 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:14.299531 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:14.299532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:14.299543 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:14.301566 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:14.301948 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:14.301951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:14.301951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:14.302057 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:14.302265 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:14.302266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:14.302267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:14.302604 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:14.302756 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:14.302853 (+ 97us) server_negotiation.cc:299] Negotiation successful
0619 02:47:14.302990 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260619 02:47:14.304472 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:47:14.330642 26574 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:47:14.331230 26574 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:14.334667 26574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25ed526d40c947a4a574ad1e84eefcd0: Generated new TSK 0
I20260619 02:47:14.334864 26574 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:47:14.358297 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26492
2026-06-19T02:47:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1339 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:47:14 dist-test-slave-fbl4 krb5kdc[26587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:47:14 dist-test-slave-fbl4 krb5kdc[26587](info): set up 2 sockets
Jun 19 02:47:14 dist-test-slave-fbl4 krb5kdc[26587](info): commencing operation
krb5kdc: starting...
W20260619 02:47:15.402927 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:47:15 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:47:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:47:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:47:15.515739 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39467
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:39467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:15.594933 26600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:15.595175 26600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:15.595211 26600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:15.596366 26600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:15.596434 26600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:15.596462 26600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:15.596490 26600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:15.596510 26600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:15.597942 26600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:39467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:15.598212 26600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:15.598430 26600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:15.603264 26605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:15.603411 26600 server_base.cc:1034] running on GCE node
W20260619 02:47:15.603243 26608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:15.603299 26606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:15.603758 26600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:15.604089 26600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:15.605264 26600 hybrid_clock.cc:648] HybridClock initialized: now 1781837235605248 us; error 28 us; skew 500 ppm
Jun 19 02:47:15 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837235, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:15.607741 26600 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:15.608215 26600 webserver.cc:460] Webserver started at http://127.12.145.126:32791/ using document root <none> and password file <none>
I20260619 02:47:15.608439 26600 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:15.608508 26600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:15.608661 26600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:15.609697 26600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "7c351bcdd3a44f1f84d18def60e18647"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "eb61cf92cf9bb498e5a604570ec41183"
server_key_iv: "ce08e265b8ce2399ea501773ee9b7281"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.610059 26600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "7c351bcdd3a44f1f84d18def60e18647"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "eb61cf92cf9bb498e5a604570ec41183"
server_key_iv: "ce08e265b8ce2399ea501773ee9b7281"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.611478 26600 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:47:15.612273 26615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.612469 26600 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:15.612571 26600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "7c351bcdd3a44f1f84d18def60e18647"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "eb61cf92cf9bb498e5a604570ec41183"
server_key_iv: "ce08e265b8ce2399ea501773ee9b7281"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.612653 26600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:15.632786 26600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:15.634670 26600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:15.634827 26600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:15.638844 26600 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:39467
I20260619 02:47:15.638900 26667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:39467 every 8 connection(s)
I20260619 02:47:15.639253 26600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:15.639940 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26600
I20260619 02:47:15.640081 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:47:15.640282 12869 external_mini_cluster.cc:1428] Setting key c14be5b8e5b19eb2cf8c2e7d24ee3ba9
I20260619 02:47:15.640439 26668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:15.643759 26668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Bootstrap starting.
I20260619 02:47:15.644474 26668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:15.644762 26668 log.cc:824] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:15.645467 26668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: No bootstrap required, opened a new log
Jun 19 02:47:15 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:15.647713 26668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:15.647866 26668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:15.647921 26668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c351bcdd3a44f1f84d18def60e18647, State: Initialized, Role: FOLLOWER
I20260619 02:47:15.648041 26668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:15.648133 26668 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:15.648185 26668 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:15.648226 26668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:15.648947 26668 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:15.649055 26668 leader_election.cc:302] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c351bcdd3a44f1f84d18def60e18647; no voters:
I20260619 02:47:15.649204 26668 leader_election.cc:288] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:47:15.649304 26673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:15.649458 26668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:15.649487 26673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 LEADER]: Becoming Leader. State: Replica: 7c351bcdd3a44f1f84d18def60e18647, State: Running, Role: LEADER
I20260619 02:47:15.649698 26673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:15.650080 26674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c351bcdd3a44f1f84d18def60e18647" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } } }
I20260619 02:47:15.650080 26675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c351bcdd3a44f1f84d18def60e18647. Latest consensus state: current_term: 1 leader_uuid: "7c351bcdd3a44f1f84d18def60e18647" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } } }
I20260619 02:47:15.650178 26675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:15.650177 26674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:15.650512 26682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:15.651204 26682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:15.651487 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:15.640813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44474 (local address 127.12.145.126:39467)
0619 02:47:15.641003 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:15.641012 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:15.641044 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:47:15.641559 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:15.641565 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:15.641611 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:15.641720 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:15.642465 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.643395 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:15.644431 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.644914 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:15.645032 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:15.647649 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:15.647653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:15.647653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:15.647662 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:15.649656 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:15.650112 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:15.650115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:15.650116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:15.650255 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:15.650468 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:15.650469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:15.650469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:15.650834 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:15.651009 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:15.651151 (+ 142us) server_negotiation.cc:299] Negotiation successful
0619 02:47:15.651285 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":104,"threads_started":1}
I20260619 02:47:15.652902 26682 catalog_manager.cc:1347] Generated new cluster ID: f1ec95da24594b0b9b794965a9d3502a
I20260619 02:47:15.652956 26682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:47:15.684437 26682 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:47:15.684983 26682 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:15.690001 26682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Generated new TSK 0
I20260619 02:47:15.690202 26682 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:47:15.727348 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39467
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:15.806362 26694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:15.806613 26694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:15.806656 26694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:15.807794 26694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:15.807864 26694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:15.807909 26694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:47:15.809319 26694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:15.809600 26694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:15.809829 26694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:15.814622 26702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:15.814652 26700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:15.814621 26699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:15.814868 26694 server_base.cc:1034] running on GCE node
I20260619 02:47:15.815084 26694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:15.815322 26694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:15.816502 26694 hybrid_clock.cc:648] HybridClock initialized: now 1781837235816490 us; error 31 us; skew 500 ppm
Jun 19 02:47:15 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837235, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:15.819003 26694 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:47:15.819367 26694 webserver.cc:460] Webserver started at http://127.12.145.65:45109/ using document root <none> and password file <none>
I20260619 02:47:15.819540 26694 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:15.819578 26694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:15.819662 26694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:15.820606 26694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "48e494fb367349b4803d0ff72c4baed5"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "1caa79fdcf7706980d99f253ad517ee5"
server_key_iv: "5d08fb46b03e920642c5d6c90f0d6c22"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.820950 26694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "48e494fb367349b4803d0ff72c4baed5"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "1caa79fdcf7706980d99f253ad517ee5"
server_key_iv: "5d08fb46b03e920642c5d6c90f0d6c22"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.822214 26694 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:47:15.822937 26709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.823089 26694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.823171 26694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "48e494fb367349b4803d0ff72c4baed5"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "1caa79fdcf7706980d99f253ad517ee5"
server_key_iv: "5d08fb46b03e920642c5d6c90f0d6c22"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.823225 26694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:15.829859 26694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:15.832053 26694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:15.832161 26694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:15.832335 26694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:15.832643 26694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:15.832677 26694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.832726 26694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:15.832751 26694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.838238 26694 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:41189
I20260619 02:47:15.838315 26822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:41189 every 8 connection(s)
I20260619 02:47:15.838682 26694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:47:15.841812 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26694
I20260619 02:47:15.841933 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:47:15.842128 12869 external_mini_cluster.cc:1428] Setting key 368053d7e55d2cb227b3d879877b54cf
Jun 19 02:47:15 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837235, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:15.848541 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:15.839454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:56981 (local address 127.12.145.126:39467)
0619 02:47:15.839496 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:15.839498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:15.839690 (+ 192us) server_negotiation.cc:407] Connection header received
0619 02:47:15.840171 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:15.840173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:15.840182 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:15.840235 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:15.841103 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.841610 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:15.842857 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.843061 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:15.843142 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:15.845504 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:15.845505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:15.845505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:15.845513 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:15.847182 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:15.847566 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:15.847568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:15.847568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:15.847636 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:15.847875 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:15.847876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:15.847876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:15.848039 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:15.848117 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:15.848351 (+ 234us) server_negotiation.cc:299] Negotiation successful
0619 02:47:15.848436 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:47:15.848604 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:15.839442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:56981)
0619 02:47:15.839593 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:15.839626 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:15.840086 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:15.840286 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:15.840289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:15.840834 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:15.841014 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:15.841019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.841688 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:15.841688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:15.842750 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:15.842753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.843184 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:15.843186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:15.843322 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:15.843847 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:15.843862 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:15.845412 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:15.847264 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:15.847270 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:15.847272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:15.847485 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:15.847709 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:15.847710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:15.847710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:15.847806 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:15.848109 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:15.848114 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:15.848223 (+ 109us) client_negotiation.cc:769] Sending connection context
0619 02:47:15.848302 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:47:15.848416 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260619 02:47:15.849134 26823 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39467
I20260619 02:47:15.849237 26823 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:15.849431 26823 heartbeater.cc:511] Master 127.12.145.126:39467 requested a full tablet report, sending...
I20260619 02:47:15.849954 26632 ts_manager.cc:194] Registered new tserver with Master: 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189)
I20260619 02:47:15.850831 26632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:56981
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:47:15.869005 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39467
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:15.949772 26828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:15.949985 26828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:15.950019 26828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:15.951243 26828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:15.951308 26828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:15.951355 26828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:47:15.952777 26828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:15.953034 26828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:15.953259 26828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:15.958112 26836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:15.958233 26828 server_base.cc:1034] running on GCE node
W20260619 02:47:15.958171 26833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:15.958150 26834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:15.958501 26828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:15.958802 26828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:15.959946 26828 hybrid_clock.cc:648] HybridClock initialized: now 1781837235959937 us; error 29 us; skew 500 ppm
Jun 19 02:47:15 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837235, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:15.962339 26828 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:47:15.962824 26828 webserver.cc:460] Webserver started at http://127.12.145.66:32923/ using document root <none> and password file <none>
I20260619 02:47:15.963085 26828 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:15.963161 26828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:15.963313 26828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:15.964335 26828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "c6aa33ee140d6c600ddf9a0335179848"
server_key_iv: "f971256319d8a69b5939dd4a2c6b8ea1"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.964695 26828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "c6aa33ee140d6c600ddf9a0335179848"
server_key_iv: "f971256319d8a69b5939dd4a2c6b8ea1"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.965952 26828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:47:15.966697 26843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.966869 26828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:47:15.966964 26828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "c6aa33ee140d6c600ddf9a0335179848"
server_key_iv: "f971256319d8a69b5939dd4a2c6b8ea1"
server_key_version: "encryptionkey@0"
I20260619 02:47:15.967046 26828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:15.986953 26828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:15.989014 26828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:15.989183 26828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:15.989419 26828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:15.989750 26828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:15.989805 26828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.989846 26828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:15.989874 26828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:15.995744 26828 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34097
I20260619 02:47:15.995786 26956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34097 every 8 connection(s)
I20260619 02:47:15.996129 26828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:47:15 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837235, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:16.003805 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26828
I20260619 02:47:16.003913 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:47:16.004110 12869 external_mini_cluster.cc:1428] Setting key ec8019c43e27464a27f5b0291f3db262
I20260619 02:47:16.005277 26959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:15.996832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:42397)
0619 02:47:15.997002 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:15.997038 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:15.997507 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:15.997708 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:15.997711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:15.998273 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:15.998460 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:15.998464 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.999162 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:15.999163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.000051 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.000053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.000394 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.000395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.000491 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.000936 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:16.000943 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:16.002310 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:16.003762 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.003768 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.003770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.004065 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.004309 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.004310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.004311 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.004435 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.004730 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:16.004736 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:16.004892 (+ 156us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.004982 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.005115 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":94,"threads_started":1}
I20260619 02:47:16.005272 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:15.996878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:42397 (local address 127.12.145.126:39467)
0619 02:47:15.996959 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:15.996961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:15.997135 (+ 174us) server_negotiation.cc:407] Connection header received
0619 02:47:15.997584 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:15.997586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:15.997601 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:15.997652 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:15.998587 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:15.999080 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.000136 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.000320 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.000377 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.002398 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.002399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.002399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.002406 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.003672 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.004178 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.004179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.004179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.004240 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.004497 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.004498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.004498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.004618 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.004705 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.005028 (+ 323us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.005132 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 02:47:16.005869 26957 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39467
I20260619 02:47:16.005980 26957 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:16.006155 26957 heartbeater.cc:511] Master 127.12.145.126:39467 requested a full tablet report, sending...
I20260619 02:47:16.006594 26632 ts_manager.cc:194] Registered new tserver with Master: de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097)
I20260619 02:47:16.006978 26632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:42397
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:47:16.029510 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39467
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:16.110212 26962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:16.110407 26962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:16.110479 26962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:16.111558 26962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:16.111593 26962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:16.111619 26962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:47:16.113061 26962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:16.113252 26962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:16.113453 26962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:16.118371 26967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.118363 26968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.118363 26970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:16.118479 26962 server_base.cc:1034] running on GCE node
I20260619 02:47:16.118817 26962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:16.119088 26962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:16.120260 26962 hybrid_clock.cc:648] HybridClock initialized: now 1781837236120247 us; error 29 us; skew 500 ppm
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:16.122845 26962 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:47:16.123271 26962 webserver.cc:460] Webserver started at http://127.12.145.67:39959/ using document root <none> and password file <none>
I20260619 02:47:16.123512 26962 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:16.123590 26962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:16.123739 26962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:16.124765 26962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "4bd5a5ce8b17467782359d925b886b50"
format_stamp: "Formatted at 2026-06-19 02:47:16 on dist-test-slave-fbl4"
server_key: "552a8677d829c81961de3e4d3ec69131"
server_key_iv: "b0909e60baf64be69de3b3d42eeb501e"
server_key_version: "encryptionkey@0"
I20260619 02:47:16.125126 26962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "4bd5a5ce8b17467782359d925b886b50"
format_stamp: "Formatted at 2026-06-19 02:47:16 on dist-test-slave-fbl4"
server_key: "552a8677d829c81961de3e4d3ec69131"
server_key_iv: "b0909e60baf64be69de3b3d42eeb501e"
server_key_version: "encryptionkey@0"
I20260619 02:47:16.126535 26962 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:47:16.127355 26977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.127535 26962 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:47:16.127645 26962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "4bd5a5ce8b17467782359d925b886b50"
format_stamp: "Formatted at 2026-06-19 02:47:16 on dist-test-slave-fbl4"
server_key: "552a8677d829c81961de3e4d3ec69131"
server_key_iv: "b0909e60baf64be69de3b3d42eeb501e"
server_key_version: "encryptionkey@0"
I20260619 02:47:16.127723 26962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:16.139602 26962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:16.141913 26962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:16.142081 26962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:16.142308 26962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:16.142676 26962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:16.142728 26962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.142771 26962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:16.142798 26962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.148629 26962 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:38555
I20260619 02:47:16.148664 27090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:38555 every 8 connection(s)
I20260619 02:47:16.149036 26962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:47:16.154356 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 26962
I20260619 02:47:16.154425 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:47:16.154639 12869 external_mini_cluster.cc:1428] Setting key 7f00ac5df203e2334bf4146714ecbb1b
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:16.158736 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.149732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:50699 (local address 127.12.145.126:39467)
0619 02:47:16.149794 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.149797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.150022 (+ 225us) server_negotiation.cc:407] Connection header received
0619 02:47:16.150657 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.150658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.150667 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.150737 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:16.151812 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.152297 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.153224 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.153417 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.153521 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.156240 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.156241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.156241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.156248 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.157548 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.157913 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.157914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.157914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.157966 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.158171 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.158171 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.158172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.158274 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.158327 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.158599 (+ 272us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.158672 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:47:16.158910 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.149729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:50699)
0619 02:47:16.149886 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.149929 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.150513 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.150796 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.150799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.151431 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:16.151731 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.151737 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.152374 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.152375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.153148 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.153150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.153529 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.153530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.153636 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.154336 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:16.154344 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:16.156153 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:16.157631 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.157636 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.157638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.157848 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.158023 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.158024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.158024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.158115 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.158329 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:16.158332 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:16.158438 (+ 106us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.158523 (+ 85us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.158706 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260619 02:47:16.159389 27091 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39467
I20260619 02:47:16.159497 27091 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:16.159668 27091 heartbeater.cc:511] Master 127.12.145.126:39467 requested a full tablet report, sending...
I20260619 02:47:16.160017 26632 ts_manager.cc:194] Registered new tserver with Master: 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555)
I20260619 02:47:16.160408 26632 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:50699
I20260619 02:47:16.166251 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:47:16.173058 26671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.167530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44486 (local address 127.12.145.126:39467)
0619 02:47:16.167590 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.167592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.167710 (+ 118us) server_negotiation.cc:407] Connection header received
0619 02:47:16.167745 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.167746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.167754 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.167806 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:16.168307 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.168768 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.169438 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.169712 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.169766 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.170937 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.170938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.170938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.170944 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.172118 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.172414 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.172415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.172416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.172470 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.172634 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.172635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.172635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.172762 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.172839 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.172930 (+ 91us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.172996 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:47:16.174655 26632 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44486:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:47:16.176178 26632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:47:16.182638 27104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.178493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49620 (local address 127.12.145.67:38555)
0619 02:47:16.178687 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.178691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.178796 (+ 105us) server_negotiation.cc:407] Connection header received
0619 02:47:16.178861 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.178863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.178880 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.179135 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:16.179196 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.180278 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.181514 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.182182 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.182288 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.182349 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.182493 (+ 144us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.182542 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":123,"threads_started":1}
I20260619 02:47:16.182641 27102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.178344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:38555 (local address 127.0.0.1:49620)
0619 02:47:16.178714 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.178723 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.178797 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.178986 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.178987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.178989 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:16.179053 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.179055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.180384 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.180385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.181433 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.181434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.182293 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.182293 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.182381 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.182394 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.182463 (+ 69us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.182515 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":48,"threads_started":1}
I20260619 02:47:16.182853 27101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.178248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34898 (local address 127.12.145.65:41189)
0619 02:47:16.178932 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.178937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.178947 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:47:16.178984 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.178986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.179004 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.179089 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:16.179284 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.179975 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.181398 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.182183 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.182258 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.182321 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.182704 (+ 383us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.182760 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":90,"threads_started":1}
I20260619 02:47:16.182869 27099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.178149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41189 (local address 127.0.0.1:34898)
0619 02:47:16.178312 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.178352 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.178412 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.179172 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.179172 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.179175 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:16.179206 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.179207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.180091 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.180092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.181314 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.181316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.182368 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.182369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.182470 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.182475 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.182527 (+ 52us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.182585 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"spinlock_wait_cycles":896,"thread_start_us":62,"threads_started":1}
I20260619 02:47:16.183633 27025 tablet_service.cc:1467] Processing CreateTablet for tablet fc004f5c5d88426c9365326ff81349ea (DEFAULT_TABLE table=test-table [id=21d5f142307c4d80810ba87735a0f316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:16.183627 26757 tablet_service.cc:1467] Processing CreateTablet for tablet fc004f5c5d88426c9365326ff81349ea (DEFAULT_TABLE table=test-table [id=21d5f142307c4d80810ba87735a0f316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:16.183902 27025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc004f5c5d88426c9365326ff81349ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:16.183970 26757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc004f5c5d88426c9365326ff81349ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:16.186358 27105 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Bootstrap starting.
I20260619 02:47:16.186852 27106 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Bootstrap starting.
I20260619 02:47:16.186915 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.178150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34097 (local address 127.0.0.1:34084)
0619 02:47:16.178513 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.178521 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.178612 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.178816 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.178820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.178822 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:16.179084 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.179087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.181510 (+ 2423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.181511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.182150 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.182152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.186650 (+ 4498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.186651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.186731 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.186737 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.186807 (+ 70us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.186848 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":8,"thread_start_us":61,"threads_started":1}
I20260619 02:47:16.186971 27103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.178332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34084 (local address 127.12.145.66:34097)
0619 02:47:16.178516 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.178521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.178590 (+ 69us) server_negotiation.cc:407] Connection header received
0619 02:47:16.178699 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.178701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.178718 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.178859 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:16.179145 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.180280 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.182240 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.186514 (+ 4274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.186644 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.186708 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.186831 (+ 123us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.186878 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":119,"threads_started":1}
I20260619 02:47:16.187095 27105 tablet_bootstrap.cc:654] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:16.187580 27106 tablet_bootstrap.cc:654] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:16.187590 27105 log.cc:824] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:16.187906 26891 tablet_service.cc:1467] Processing CreateTablet for tablet fc004f5c5d88426c9365326ff81349ea (DEFAULT_TABLE table=test-table [id=21d5f142307c4d80810ba87735a0f316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:16.188184 27106 log.cc:824] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:16.188237 26891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc004f5c5d88426c9365326ff81349ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:16.188334 27105 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: No bootstrap required, opened a new log
I20260619 02:47:16.188401 27105 ts_tablet_manager.cc:1397] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:47:16.188928 27106 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: No bootstrap required, opened a new log
I20260619 02:47:16.188992 27106 ts_tablet_manager.cc:1397] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:47:16.190316 27105 raft_consensus.cc:348] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.190469 27105 raft_consensus.cc:374] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:16.190505 27105 raft_consensus.cc:729] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bd5a5ce8b17467782359d925b886b50, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.190640 27105 consensus_queue.cc:260] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.190841 27109 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Bootstrap starting.
I20260619 02:47:16.190896 27105 ts_tablet_manager.cc:1428] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:47:16.190912 27106 raft_consensus.cc:348] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.191046 27106 raft_consensus.cc:374] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:16.191035 27091 heartbeater.cc:503] Master 127.12.145.126:39467 was elected leader, sending a full tablet report...
I20260619 02:47:16.191077 27106 raft_consensus.cc:729] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48e494fb367349b4803d0ff72c4baed5, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.191164 27106 consensus_queue.cc:260] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.191409 27106 ts_tablet_manager.cc:1428] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:47:16.191463 26823 heartbeater.cc:503] Master 127.12.145.126:39467 was elected leader, sending a full tablet report...
I20260619 02:47:16.191788 27109 tablet_bootstrap.cc:654] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:16.192355 27109 log.cc:824] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:16.192971 27109 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: No bootstrap required, opened a new log
I20260619 02:47:16.193058 27109 ts_tablet_manager.cc:1397] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:47:16.194614 27109 raft_consensus.cc:348] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.194761 27109 raft_consensus.cc:374] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:16.194804 27109 raft_consensus.cc:729] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de1fbd9c9dd74483a110f1f9ea2ff5ff, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.194912 27109 consensus_queue.cc:260] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.195165 27109 ts_tablet_manager.cc:1428] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:47:16.195204 26957 heartbeater.cc:503] Master 127.12.145.126:39467 was elected leader, sending a full tablet report...
W20260619 02:47:16.246716 26958 tablet.cc:2369] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:16.332252 27110 raft_consensus.cc:482] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:16.332369 27110 raft_consensus.cc:504] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.332716 27110 leader_election.cc:288] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097), 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189)
I20260619 02:47:16.336237 27101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.333076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:53283 (local address 127.12.145.65:41189)
0619 02:47:16.333117 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.333120 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.333128 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:47:16.333159 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.333160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.333171 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.333240 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:16.333460 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.333997 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.335257 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.335834 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.335907 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.335918 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.336150 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.336184 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:47:16.336270 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.332913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41189 (local address 127.12.145.67:53283)
0619 02:47:16.332996 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.333009 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.333061 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.333297 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.333298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.333300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:16.333390 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.333391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.334072 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.334073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.335172 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.335174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.335944 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.335945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.336061 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.336066 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.336137 (+ 71us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.336179 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 02:47:16.336665 26777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc004f5c5d88426c9365326ff81349ea" candidate_uuid: "4bd5a5ce8b17467782359d925b886b50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48e494fb367349b4803d0ff72c4baed5" is_pre_election: true
I20260619 02:47:16.336853 26777 raft_consensus.cc:2454] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bd5a5ce8b17467782359d925b886b50 in term 0.
I20260619 02:47:16.337015 27114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.332914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34097 (local address 127.12.145.67:50139)
0619 02:47:16.333161 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.333172 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.333230 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.333887 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.333888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.333890 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:16.333957 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.333958 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.334917 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.334918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.335976 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.335978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.336710 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.336711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.336831 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.336835 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.336894 (+ 59us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.336938 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":67,"thread_start_us":117,"threads_started":1}
I20260619 02:47:16.337028 27103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.332996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:50139 (local address 127.12.145.66:34097)
0619 02:47:16.333047 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.333049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.333236 (+ 187us) server_negotiation.cc:407] Connection header received
0619 02:47:16.333313 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.333314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.333325 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.333853 (+ 528us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:16.334058 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.334829 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.336076 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.336621 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.336712 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.336720 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.336902 (+ 182us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.336948 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260619 02:47:16.337098 26981 leader_election.cc:302] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5, 4bd5a5ce8b17467782359d925b886b50; no voters:
I20260619 02:47:16.337304 27110 raft_consensus.cc:2781] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:47:16.337379 27110 raft_consensus.cc:482] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:47:16.337402 27110 raft_consensus.cc:3037] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:16.337491 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc004f5c5d88426c9365326ff81349ea" candidate_uuid: "4bd5a5ce8b17467782359d925b886b50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" is_pre_election: true
I20260619 02:47:16.337639 26911 raft_consensus.cc:2454] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bd5a5ce8b17467782359d925b886b50 in term 0.
I20260619 02:47:16.338251 27110 raft_consensus.cc:504] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.338397 27110 leader_election.cc:288] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [CANDIDATE]: Term 1 election: Requested vote from peers de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097), 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189)
I20260619 02:47:16.338524 26911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc004f5c5d88426c9365326ff81349ea" candidate_uuid: "4bd5a5ce8b17467782359d925b886b50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff"
I20260619 02:47:16.338533 26777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc004f5c5d88426c9365326ff81349ea" candidate_uuid: "4bd5a5ce8b17467782359d925b886b50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48e494fb367349b4803d0ff72c4baed5"
I20260619 02:47:16.338624 26777 raft_consensus.cc:3037] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:16.338621 26911 raft_consensus.cc:3037] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:16.339352 26777 raft_consensus.cc:2454] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bd5a5ce8b17467782359d925b886b50 in term 1.
W20260619 02:47:16.339394 26824 tablet.cc:2369] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:16.339385 26911 raft_consensus.cc:2454] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bd5a5ce8b17467782359d925b886b50 in term 1.
I20260619 02:47:16.339506 26981 leader_election.cc:302] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5, 4bd5a5ce8b17467782359d925b886b50; no voters:
I20260619 02:47:16.339672 27110 raft_consensus.cc:2781] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:16.339828 27110 raft_consensus.cc:686] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 1 LEADER]: Becoming Leader. State: Replica: 4bd5a5ce8b17467782359d925b886b50, State: Running, Role: LEADER
I20260619 02:47:16.339931 27110 consensus_queue.cc:237] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.340791 26632 catalog_manager.cc:5495] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67). New cstate: current_term: 1 leader_uuid: "4bd5a5ce8b17467782359d925b886b50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } health_report { overall_health: HEALTHY } } }
I20260619 02:47:16.363989 27104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.360964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49636 (local address 127.12.145.67:38555)
0619 02:47:16.361028 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.361030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.361040 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:47:16.361109 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.361110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.361127 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.361207 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:47:16.361343 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.361816 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.362766 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.362978 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.363080 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.363259 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:47:16.363435 (+ 176us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:47:16.363841 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.363862 (+ 21us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.363885 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:47:16.365716 26911 raft_consensus.cc:1261] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 FOLLOWER]: Refusing update from remote peer 4bd5a5ce8b17467782359d925b886b50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:16.365758 26777 raft_consensus.cc:1261] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Refusing update from remote peer 4bd5a5ce8b17467782359d925b886b50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:16.366060 27110 consensus_queue.cc:1035] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:16.366199 27115 consensus_queue.cc:1035] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:16.368631 27118 mvcc.cc:205] Tried to move back new op lower bound from 7298405320151580672 to 7298405320049061888. Current Snapshot: MvccSnapshot[applied={T|T < 7298405320151580672}]
I20260619 02:47:16.368953 27120 mvcc.cc:205] Tried to move back new op lower bound from 7298405320151580672 to 7298405320049061888. Current Snapshot: MvccSnapshot[applied={T|T < 7298405320151580672}]
I20260619 02:47:16.370914 26631 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:16.371029 26631 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:16.371799 26631 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Sending DeleteTablet for 3 replicas of tablet fc004f5c5d88426c9365326ff81349ea
I20260619 02:47:16.372112 26891 tablet_service.cc:1514] Processing DeleteTablet for tablet fc004f5c5d88426c9365326ff81349ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:16 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34084
I20260619 02:47:16.372223 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26694
I20260619 02:47:16.372241 26757 tablet_service.cc:1514] Processing DeleteTablet for tablet fc004f5c5d88426c9365326ff81349ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:16 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34898
I20260619 02:47:16.372313 27025 tablet_service.cc:1514] Processing DeleteTablet for tablet fc004f5c5d88426c9365326ff81349ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:16 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:49620
I20260619 02:47:16.372612 27128 tablet_replica.cc:330] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: stopping tablet replica
I20260619 02:47:16.372741 27128 raft_consensus.cc:2229] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:16.372880 27128 raft_consensus.cc:2258] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:16.373311 27128 ts_tablet_manager.cc:1905] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:16.375423 27128 ts_tablet_manager.cc:1918] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:16.375540 27128 log.cc:1196] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/fc004f5c5d88426c9365326ff81349ea
I20260619 02:47:16.375849 27128 ts_tablet_manager.cc:1939] T fc004f5c5d88426c9365326ff81349ea P de1fbd9c9dd74483a110f1f9ea2ff5ff: Deleting consensus metadata
I20260619 02:47:16.376276 26616 catalog_manager.cc:4841] TS de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097): tablet fc004f5c5d88426c9365326ff81349ea (table test-table [id=21d5f142307c4d80810ba87735a0f316]) successfully deleted
I20260619 02:47:16.378695 27129 tablet_replica.cc:330] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: stopping tablet replica
I20260619 02:47:16.378811 27129 raft_consensus.cc:2229] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 1 LEADER]: Raft consensus shutting down.
W20260619 02:47:16.378911 26619 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:41189 (error 108)
I20260619 02:47:16.378937 27129 raft_consensus.cc:2258] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:16.379168 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26828
I20260619 02:47:16.379351 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.379213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41189 (local address 127.0.0.1:34900)
0619 02:47:16.379273 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.379311 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:41189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260619 02:47:16.379814 26619 catalog_manager.cc:4584] TS 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fc004f5c5d88426c9365326ff81349ea: Network error: Client connection negotiation failed: client connection to 127.12.145.65:41189: connect: Connection refused (error 111)
I20260619 02:47:16.380273 27129 ts_tablet_manager.cc:1905] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:16.381798 27129 ts_tablet_manager.cc:1918] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:16.381870 27129 log.cc:1196] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/fc004f5c5d88426c9365326ff81349ea
I20260619 02:47:16.382192 27129 ts_tablet_manager.cc:1939] T fc004f5c5d88426c9365326ff81349ea P 4bd5a5ce8b17467782359d925b886b50: Deleting consensus metadata
I20260619 02:47:16.382627 26616 catalog_manager.cc:4841] TS 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555): tablet fc004f5c5d88426c9365326ff81349ea (table test-table [id=21d5f142307c4d80810ba87735a0f316]) successfully deleted
I20260619 02:47:16.385255 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26962
I20260619 02:47:16.391117 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 26600
I20260619 02:47:16.396163 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39467
--webserver_interface=127.12.145.126
--webserver_port=32791
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:39467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:16.476253 27131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:16.476449 27131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:16.476472 27131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:16.477733 27131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:16.477777 27131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:16.477792 27131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:16.477804 27131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:16.477816 27131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:16.479323 27131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:39467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:16.479591 27131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:16.479830 27131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:16.488354 27140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.488348 27137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.488361 27138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:16.488693 27131 server_base.cc:1034] running on GCE node
I20260619 02:47:16.488945 27131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:16.489260 27131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:16.490450 27131 hybrid_clock.cc:648] HybridClock initialized: now 1781837236490437 us; error 30 us; skew 500 ppm
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:16.492966 27131 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:16.493345 27131 webserver.cc:460] Webserver started at http://127.12.145.126:32791/ using document root <none> and password file <none>
I20260619 02:47:16.493570 27131 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:16.493623 27131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:16.494997 27131 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:47:16.495572 27147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.495744 27131 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:47:16.495849 27131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "7c351bcdd3a44f1f84d18def60e18647"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "eb61cf92cf9bb498e5a604570ec41183"
server_key_iv: "ce08e265b8ce2399ea501773ee9b7281"
server_key_version: "encryptionkey@0"
I20260619 02:47:16.496245 27131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:16.516564 27131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:16.518491 27131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:16.518676 27131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:16.522439 27131 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:39467
I20260619 02:47:16.522470 27199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:39467 every 8 connection(s)
I20260619 02:47:16.522873 27131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:16.524426 27200 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:47:16.525090 27200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Bootstrap starting.
I20260619 02:47:16.531035 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 27131
I20260619 02:47:16.531347 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:41189
--local_ip_for_outbound_sockets=127.12.145.65
--tserver_master_addrs=127.12.145.126:39467
--webserver_port=45109
--webserver_interface=127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:16.533454 27200 log.cc:824] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:16.535480 27200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:47:16.535799 27200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Bootstrap complete.
I20260619 02:47:16.538084 27200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:16.538340 27200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c351bcdd3a44f1f84d18def60e18647, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.538543 27200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:16.538664 27200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:16.538724 27200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:16.538774 27200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 1 FOLLOWER]: Advancing to term 2
I20260619 02:47:16.539793 27200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:16.539916 27200 leader_election.cc:302] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c351bcdd3a44f1f84d18def60e18647; no voters:
I20260619 02:47:16.540119 27200 leader_election.cc:288] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 02:47:16.540159 27204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 02:47:16.540261 27204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 LEADER]: Becoming Leader. State: Replica: 7c351bcdd3a44f1f84d18def60e18647, State: Running, Role: LEADER
I20260619 02:47:16.540395 27200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:16.540416 27204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:16.540793 27205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7c351bcdd3a44f1f84d18def60e18647" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } } }
I20260619 02:47:16.540868 27205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:16.541180 27206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c351bcdd3a44f1f84d18def60e18647. Latest consensus state: current_term: 2 leader_uuid: "7c351bcdd3a44f1f84d18def60e18647" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } } }
I20260619 02:47:16.541249 27206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:16.541237 27210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:16.542147 27210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:16.542239 27210 catalog_manager.cc:1259] Loaded cluster ID: f1ec95da24594b0b9b794965a9d3502a
I20260619 02:47:16.542313 27210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:47:16.542886 27210 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260619 02:47:16.547585 27210 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260619 02:47:16.550083 27210 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:16.550310 27210 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Loaded TSK: 0
I20260619 02:47:16.550585 27210 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 02:47:16.617045 27202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:16.617295 27202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:16.617321 27202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:16.618569 27202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:16.618646 27202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:16.618691 27202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:47:16.620183 27202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:41189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=45109
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:16.620457 27202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:16.620712 27202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:16.627061 27228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.627137 27229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.627074 27231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:16.627272 27202 server_base.cc:1034] running on GCE node
I20260619 02:47:16.627772 27202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:16.628108 27202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:16.629312 27202 hybrid_clock.cc:648] HybridClock initialized: now 1781837236629298 us; error 31 us; skew 500 ppm
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:16.632570 27202 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:47:16.633113 27202 webserver.cc:460] Webserver started at http://127.12.145.65:45109/ using document root <none> and password file <none>
I20260619 02:47:16.633354 27202 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:16.633450 27202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:16.634914 27202 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:47:16.635691 27238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.635942 27202 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:16.636057 27202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "48e494fb367349b4803d0ff72c4baed5"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "1caa79fdcf7706980d99f253ad517ee5"
server_key_iv: "5d08fb46b03e920642c5d6c90f0d6c22"
server_key_version: "encryptionkey@0"
I20260619 02:47:16.636415 27202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:16.644794 27202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:16.647239 27202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:16.647404 27202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:16.647678 27202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:16.648157 27245 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260619 02:47:16.650084 27202 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 02:47:16.650179 27202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260619 02:47:16.650228 27202 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 02:47:16.650976 27202 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 02:47:16.651036 27202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260619 02:47:16.651105 27245 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Bootstrap starting.
I20260619 02:47:16.658418 27202 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:41189
I20260619 02:47:16.658475 27352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:41189 every 8 connection(s)
I20260619 02:47:16.658914 27202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:47:16.662215 27245 log.cc:824] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:16.665055 27245 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:47:16.665397 27245 tablet_bootstrap.cc:492] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Bootstrap complete.
I20260619 02:47:16.666676 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 27202
I20260619 02:47:16.666730 27245 ts_tablet_manager.cc:1397] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260619 02:47:16.666944 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:34097
--local_ip_for_outbound_sockets=127.12.145.66
--tserver_master_addrs=127.12.145.126:39467
--webserver_port=32923
--webserver_interface=127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:16.668052 27245 raft_consensus.cc:348] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.668350 27245 raft_consensus.cc:729] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48e494fb367349b4803d0ff72c4baed5, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.668504 27245 consensus_queue.cc:260] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } } peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } }
I20260619 02:47:16.669160 27245 ts_tablet_manager.cc:1428] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:16.675732 27355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.659694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:53299)
0619 02:47:16.662652 (+ 2958us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.662710 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.663266 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.663762 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.663766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.664076 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:16.664266 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.664272 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.665975 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.665976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.667318 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.667322 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.668297 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.668299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.668446 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.669073 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:16.669083 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:16.670942 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:16.673581 (+ 2639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.673589 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.673592 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.673945 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.674301 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.674301 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.674302 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.674438 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.675011 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:16.675017 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:16.675173 (+ 156us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.675277 (+ 104us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.675505 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2907,"thread_start_us":105,"threads_started":1}
I20260619 02:47:16.675806 27356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.659769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:53299 (local address 127.12.145.126:39467)
0619 02:47:16.662784 (+ 3015us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.662793 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.662842 (+ 49us) server_negotiation.cc:407] Connection header received
0619 02:47:16.663535 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.663540 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.663589 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.663734 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:16.664400 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.665455 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.667426 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.668082 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.668188 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.671077 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.671081 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.671082 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.671095 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.673463 (+ 2368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.674067 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.674071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.674072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.674216 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.674528 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.674529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.674530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.674922 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.675020 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.675383 (+ 363us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.675545 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2955,"thread_start_us":69,"threads_started":1}
I20260619 02:47:16.677055 27353 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39467
I20260619 02:47:16.677150 27353 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:16.677348 27353 heartbeater.cc:511] Master 127.12.145.126:39467 requested a full tablet report, sending...
I20260619 02:47:16.678149 27164 ts_manager.cc:194] Registered new tserver with Master: 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189)
I20260619 02:47:16.679526 27164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:53299
I20260619 02:47:16.680439 27353 heartbeater.cc:503] Master 127.12.145.126:39467 was elected leader, sending a full tablet report...
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.65@KRBTEST.COM
I20260619 02:47:16.689491 27360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.678860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41189 (local address 127.0.0.1:34908)
0619 02:47:16.679243 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.679277 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.679340 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.679638 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.679643 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.681021 (+ 1378us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:16.681081 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.681083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.682327 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.682328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.683298 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.683300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.683956 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.683957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.684029 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.684627 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:16.684632 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:16.686193 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:16.688221 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.688228 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.688230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.688478 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.688720 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.688721 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.688721 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.688785 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.689100 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:16.689106 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:16.689160 (+ 54us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.689269 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.689392 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":90,"threads_started":1}
I20260619 02:47:16.689491 27361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.679101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34908 (local address 127.12.145.65:41189)
0619 02:47:16.679450 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.679454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.679462 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:47:16.679492 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.679494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.679507 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.679579 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:16.681159 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.682235 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.683389 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.683840 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.683899 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.686286 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.686294 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.686294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.686301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.688127 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.688584 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.688587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.688587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.688650 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.688858 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.688859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.688859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.689006 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.689118 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.689304 (+ 186us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.689390 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":65,"threads_started":1}
I20260619 02:47:16.689942 27287 tablet_service.cc:1514] Processing DeleteTablet for tablet fc004f5c5d88426c9365326ff81349ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:16 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34908
I20260619 02:47:16.690596 27362 tablet_replica.cc:330] stopping tablet replica
I20260619 02:47:16.690698 27362 raft_consensus.cc:2229] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:16.690763 27362 raft_consensus.cc:2258] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:16.691073 27362 ts_tablet_manager.cc:1905] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:16.693296 27362 ts_tablet_manager.cc:1918] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:16.693380 27362 log.cc:1196] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/fc004f5c5d88426c9365326ff81349ea
I20260619 02:47:16.693603 27362 ts_tablet_manager.cc:1939] T fc004f5c5d88426c9365326ff81349ea P 48e494fb367349b4803d0ff72c4baed5: Deleting consensus metadata
I20260619 02:47:16.694106 27151 catalog_manager.cc:4841] TS 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189): tablet fc004f5c5d88426c9365326ff81349ea (table test-table [id=21d5f142307c4d80810ba87735a0f316]) successfully deleted
W20260619 02:47:16.757700 27358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:16.757899 27358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:16.757927 27358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:16.759114 27358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:16.759155 27358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:16.759181 27358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:47:16.760623 27358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:34097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=32923
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:16.760859 27358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:16.761090 27358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:16.766111 27370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.766124 27368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.766120 27367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:16.766415 27358 server_base.cc:1034] running on GCE node
I20260619 02:47:16.766726 27358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:16.767014 27358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:16.768185 27358 hybrid_clock.cc:648] HybridClock initialized: now 1781837236768171 us; error 28 us; skew 500 ppm
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:16.770649 27358 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:47:16.771085 27358 webserver.cc:460] Webserver started at http://127.12.145.66:32923/ using document root <none> and password file <none>
I20260619 02:47:16.771330 27358 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:16.771417 27358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:16.772754 27358 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:16.773331 27377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.773526 27358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.773627 27358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "c6aa33ee140d6c600ddf9a0335179848"
server_key_iv: "f971256319d8a69b5939dd4a2c6b8ea1"
server_key_version: "encryptionkey@0"
I20260619 02:47:16.773978 27358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:16.789769 27358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:16.791646 27358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:16.791806 27358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:16.792027 27358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:16.792317 27358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:16.792372 27358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.792411 27358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:16.792440 27358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.798210 27358 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34097
I20260619 02:47:16.798261 27490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34097 every 8 connection(s)
I20260619 02:47:16.798677 27358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:16.806121 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 27358
I20260619 02:47:16.806404 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:38555
--local_ip_for_outbound_sockets=127.12.145.67
--tserver_master_addrs=127.12.145.126:39467
--webserver_port=39959
--webserver_interface=127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:16.807354 27356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.799420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:59711 (local address 127.12.145.126:39467)
0619 02:47:16.799485 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.799487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.799685 (+ 198us) server_negotiation.cc:407] Connection header received
0619 02:47:16.800136 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.800137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.800146 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.800197 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:16.801035 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.801591 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.802507 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.802770 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.802822 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.804719 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.804720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.804721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.804727 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.805942 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.806401 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.806402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.806403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.806453 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.806756 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.806756 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.806757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.806860 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.806914 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.807227 (+ 313us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.807291 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:47:16.807638 27493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.799426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:59711)
0619 02:47:16.799571 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.799603 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.800056 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.800244 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.800247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.800775 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:16.800959 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.800964 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.801692 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.801693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.802438 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.802440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.802839 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.802839 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.802936 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.803303 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:16.803310 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:16.804620 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:16.806024 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.806031 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.806034 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.806333 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.806529 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.806530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.806530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.806691 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.806936 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:16.806941 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:16.807100 (+ 159us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.807209 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.807370 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
I20260619 02:47:16.808179 27491 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39467
I20260619 02:47:16.808284 27491 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:16.808452 27491 heartbeater.cc:511] Master 127.12.145.126:39467 requested a full tablet report, sending...
I20260619 02:47:16.808867 27164 ts_manager.cc:194] Registered new tserver with Master: de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097)
I20260619 02:47:16.809360 27164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:59711
W20260619 02:47:16.888656 27494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:16.888844 27494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:16.888866 27494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:16.889910 27494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:16.889945 27494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:16.889971 27494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:47:16.891386 27494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:38555
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=39959
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:16.891561 27494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:16.891722 27494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:16.896487 27500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.896528 27502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:16.896528 27499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:16.896639 27494 server_base.cc:1034] running on GCE node
I20260619 02:47:16.896878 27494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:16.897122 27494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:16.898335 27494 hybrid_clock.cc:648] HybridClock initialized: now 1781837236898316 us; error 32 us; skew 500 ppm
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:16.900836 27494 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:47:16.901270 27494 webserver.cc:460] Webserver started at http://127.12.145.67:39959/ using document root <none> and password file <none>
I20260619 02:47:16.901443 27494 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:16.901494 27494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:16.902871 27494 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:16.903405 27509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.903570 27494 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:47:16.903667 27494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "4bd5a5ce8b17467782359d925b886b50"
format_stamp: "Formatted at 2026-06-19 02:47:16 on dist-test-slave-fbl4"
server_key: "552a8677d829c81961de3e4d3ec69131"
server_key_iv: "b0909e60baf64be69de3b3d42eeb501e"
server_key_version: "encryptionkey@0"
I20260619 02:47:16.903983 27494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:16.912736 27494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:16.914469 27494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:16.914645 27494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:16.914856 27494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:16.915153 27494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:16.915207 27494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.915247 27494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:16.915275 27494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:16.921022 27494 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:38555
I20260619 02:47:16.921066 27622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:38555 every 8 connection(s)
I20260619 02:47:16.921384 27494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:47:16.921828 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 27494
Jun 19 02:47:16 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837236, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:16.929841 27626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.922217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44498 (local address 127.12.145.126:39467)
0619 02:47:16.922326 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.922328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.922421 (+ 93us) server_negotiation.cc:407] Connection header received
0619 02:47:16.922493 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.922494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.922506 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.922605 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:16.923206 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.924023 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.925053 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.925345 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.925418 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.926893 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.926895 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.926895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.926903 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.928520 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.928948 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.928949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.928949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.929007 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.929226 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.929227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.929227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.929358 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.929563 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.929604 (+ 41us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.929712 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":46,"threads_started":1}
I20260619 02:47:16.931895 27356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.922113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:55113 (local address 127.12.145.126:39467)
0619 02:47:16.922165 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.922168 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.922457 (+ 289us) server_negotiation.cc:407] Connection header received
0619 02:47:16.923020 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.923021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.923033 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.923106 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:16.924208 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.924928 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.926028 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.926368 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.926444 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.929107 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:16.929108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:16.929108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:16.929114 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:16.930705 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.931073 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.931074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.931075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.931130 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:16.931353 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:16.931353 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:16.931354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:16.931483 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:16.931545 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.931775 (+ 230us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.931835 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260619 02:47:16.932086 27625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.922026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:55113)
0619 02:47:16.922327 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.922368 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.922924 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.923154 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.923181 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.923878 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:16.924125 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.924130 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.925036 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.925037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.925948 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.925950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.926511 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.926512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.926705 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.927277 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:16.927287 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:16.928997 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:16.930775 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.930780 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.930781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.930985 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.931201 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:16.931201 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:16.931202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:16.931293 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:16.931544 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:16.931547 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:16.931665 (+ 118us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.931744 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.931853 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":81,"threads_started":1}
I20260619 02:47:16.932508 27623 heartbeater.cc:347] Connected to a master server at 127.12.145.126:39467
I20260619 02:47:16.932591 27623 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:16.932783 27623 heartbeater.cc:511] Master 127.12.145.126:39467 requested a full tablet report, sending...
I20260619 02:47:16.933171 27164 ts_manager.cc:194] Registered new tserver with Master: 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555)
I20260619 02:47:16.933601 27164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:55113
I20260619 02:47:16.941341 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:47:16.943997 27356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.941747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44508 (local address 127.12.145.126:39467)
0619 02:47:16.941802 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.941804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.941920 (+ 116us) server_negotiation.cc:407] Connection header received
0619 02:47:16.941974 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.941975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.942004 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.942061 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:47:16.942165 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.942668 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.943357 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.943528 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.943575 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.943712 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:47:16.943797 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:47:16.943853 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.943886 (+ 33us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.943900 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260619 02:47:16.944293 27164 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:44508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:47:16.945854 27164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:47:16.948206 27287 tablet_service.cc:1467] Processing CreateTablet for tablet d671596735e6443696e9e5941006741a (DEFAULT_TABLE table=test-table [id=294d226a44cc47da8d1f08415db87ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:16.948418 27287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d671596735e6443696e9e5941006741a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:16.949852 27245 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Bootstrap starting.
I20260619 02:47:16.950218 27245 tablet_bootstrap.cc:654] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:16.950814 27245 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: No bootstrap required, opened a new log
I20260619 02:47:16.950863 27245 ts_tablet_manager.cc:1397] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260619 02:47:16.951208 27245 raft_consensus.cc:348] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:16.951279 27245 raft_consensus.cc:374] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:16.951318 27245 raft_consensus.cc:729] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48e494fb367349b4803d0ff72c4baed5, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.951370 27245 consensus_queue.cc:260] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:16.951464 27245 ts_tablet_manager.cc:1428] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:16.951824 27360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.947809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:38555 (local address 127.0.0.1:49646)
0619 02:47:16.947868 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.947880 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.947926 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.948304 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.948305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.948307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:16.948345 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.948347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.949434 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.949436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.950615 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.950618 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.951549 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.951550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.951641 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.951663 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.951697 (+ 34us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.951739 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260619 02:47:16.952211 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.947913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49646 (local address 127.12.145.67:38555)
0619 02:47:16.948120 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.948125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.948137 (+ 12us) server_negotiation.cc:407] Connection header received
0619 02:47:16.948174 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.948176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.948192 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.948278 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:16.948427 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.949331 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.950697 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.951439 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.952034 (+ 595us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.952102 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.952124 (+ 22us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.952155 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":93,"threads_started":1}
I20260619 02:47:16.952934 27557 tablet_service.cc:1467] Processing CreateTablet for tablet d671596735e6443696e9e5941006741a (DEFAULT_TABLE table=test-table [id=294d226a44cc47da8d1f08415db87ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:16.953284 27557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d671596735e6443696e9e5941006741a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:16.953478 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.947897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34097 (local address 127.0.0.1:34094)
0619 02:47:16.948363 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:16.948373 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:16.948441 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:16.950092 (+ 1651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:16.950093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:16.950096 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:16.950140 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.950141 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.951323 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.951324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.952340 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:16.952344 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.953250 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.953251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:16.953315 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.953319 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:16.953353 (+ 34us) client_negotiation.cc:240] Negotiation successful
0619 02:47:16.953411 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":115,"threads_started":1}
I20260619 02:47:16.953796 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:16.948164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34094 (local address 127.12.145.66:34097)
0619 02:47:16.949925 (+ 1761us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:16.949930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:16.949941 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:47:16.949978 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:16.949980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:16.949995 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:16.950076 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:16.950212 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.951213 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.952439 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:16.953145 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:16.953591 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:16.953652 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:16.953680 (+ 28us) server_negotiation.cc:299] Negotiation successful
0619 02:47:16.953720 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1728,"thread_start_us":88,"threads_started":1}
I20260619 02:47:16.954376 27425 tablet_service.cc:1467] Processing CreateTablet for tablet d671596735e6443696e9e5941006741a (DEFAULT_TABLE table=test-table [id=294d226a44cc47da8d1f08415db87ec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:16.954731 27425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d671596735e6443696e9e5941006741a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:16.956292 27633 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Bootstrap starting.
I20260619 02:47:16.956820 27633 tablet_bootstrap.cc:654] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:16.957260 27633 log.cc:824] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:16.957481 27634 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Bootstrap starting.
I20260619 02:47:16.958010 27633 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: No bootstrap required, opened a new log
I20260619 02:47:16.958071 27634 tablet_bootstrap.cc:654] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:16.958106 27633 ts_tablet_manager.cc:1397] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:47:16.958521 27634 log.cc:824] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:16.959254 27634 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: No bootstrap required, opened a new log
I20260619 02:47:16.959306 27634 ts_tablet_manager.cc:1397] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:47:16.959851 27633 raft_consensus.cc:348] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:16.959997 27633 raft_consensus.cc:374] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:16.960040 27633 raft_consensus.cc:729] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bd5a5ce8b17467782359d925b886b50, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.960171 27633 consensus_queue.cc:260] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:16.960428 27633 ts_tablet_manager.cc:1428] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:47:16.960469 27623 heartbeater.cc:503] Master 127.12.145.126:39467 was elected leader, sending a full tablet report...
I20260619 02:47:16.961159 27634 raft_consensus.cc:348] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:16.961315 27634 raft_consensus.cc:374] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:16.961362 27634 raft_consensus.cc:729] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de1fbd9c9dd74483a110f1f9ea2ff5ff, State: Initialized, Role: FOLLOWER
I20260619 02:47:16.961472 27634 consensus_queue.cc:260] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:16.961771 27634 ts_tablet_manager.cc:1428] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:47:16.961772 27491 heartbeater.cc:503] Master 127.12.145.126:39467 was elected leader, sending a full tablet report...
I20260619 02:47:17.047998 27638 raft_consensus.cc:482] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:17.048128 27638 raft_consensus.cc:504] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:17.048591 27638 leader_election.cc:288] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555), 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189)
W20260619 02:47:17.049219 27492 tablet.cc:2369] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:17.051957 27361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.048872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:36337 (local address 127.12.145.65:41189)
0619 02:47:17.048915 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:17.048917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:17.048926 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:47:17.049013 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:17.049014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:17.049058 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:17.049132 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:17.049312 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.050095 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.051112 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.051565 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.051685 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:17.051767 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:17.051829 (+ 62us) server_negotiation.cc:299] Negotiation successful
0619 02:47:17.051881 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:47:17.051971 27493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.048790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41189 (local address 127.12.145.66:36337)
0619 02:47:17.048846 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.048860 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:17.048911 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:17.049149 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:17.049150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:17.049152 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:17.049222 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:17.049224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.050178 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.050179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:17.051024 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:17.051027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.051690 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.051691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:17.051778 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:17.051782 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:17.051823 (+ 41us) client_negotiation.cc:240] Negotiation successful
0619 02:47:17.051853 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":24}
I20260619 02:47:17.052042 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.048831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:58241 (local address 127.12.145.67:38555)
0619 02:47:17.048896 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:17.048897 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:17.049056 (+ 159us) server_negotiation.cc:407] Connection header received
0619 02:47:17.049105 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:17.049107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:17.049118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:17.049168 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:17.049381 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.050081 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.051207 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.051577 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.051671 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:17.051682 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:17.051907 (+ 225us) server_negotiation.cc:299] Negotiation successful
0619 02:47:17.051957 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260619 02:47:17.052081 27639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.048804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:38555 (local address 127.12.145.66:58241)
0619 02:47:17.048962 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.048972 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:17.049042 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:17.049196 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:17.049196 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:17.049199 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:17.049288 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:17.049290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.050182 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.050182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:17.051124 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:17.051126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.051694 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.051695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:17.051825 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:17.051828 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:47:17.051886 (+ 58us) client_negotiation.cc:240] Negotiation successful
0619 02:47:17.051921 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":45,"thread_start_us":102,"threads_started":1}
I20260619 02:47:17.052291 27307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d671596735e6443696e9e5941006741a" candidate_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48e494fb367349b4803d0ff72c4baed5" is_pre_election: true
I20260619 02:47:17.052373 27577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d671596735e6443696e9e5941006741a" candidate_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bd5a5ce8b17467782359d925b886b50" is_pre_election: true
I20260619 02:47:17.052466 27307 raft_consensus.cc:2454] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de1fbd9c9dd74483a110f1f9ea2ff5ff in term 0.
I20260619 02:47:17.052515 27577 raft_consensus.cc:2454] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de1fbd9c9dd74483a110f1f9ea2ff5ff in term 0.
I20260619 02:47:17.052723 27378 leader_election.cc:302] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bd5a5ce8b17467782359d925b886b50, de1fbd9c9dd74483a110f1f9ea2ff5ff; no voters:
I20260619 02:47:17.052845 27638 raft_consensus.cc:2781] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:47:17.052899 27638 raft_consensus.cc:482] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:47:17.052922 27638 raft_consensus.cc:3037] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:17.053617 27638 raft_consensus.cc:504] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:17.053761 27638 leader_election.cc:288] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [CANDIDATE]: Term 1 election: Requested vote from peers 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555), 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189)
I20260619 02:47:17.053943 27307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d671596735e6443696e9e5941006741a" candidate_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48e494fb367349b4803d0ff72c4baed5"
I20260619 02:47:17.053944 27577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d671596735e6443696e9e5941006741a" candidate_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bd5a5ce8b17467782359d925b886b50"
I20260619 02:47:17.054028 27307 raft_consensus.cc:3037] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:17.054029 27577 raft_consensus.cc:3037] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:17.054901 27307 raft_consensus.cc:2454] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de1fbd9c9dd74483a110f1f9ea2ff5ff in term 1.
I20260619 02:47:17.054901 27577 raft_consensus.cc:2454] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de1fbd9c9dd74483a110f1f9ea2ff5ff in term 1.
I20260619 02:47:17.055130 27381 leader_election.cc:302] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5, de1fbd9c9dd74483a110f1f9ea2ff5ff; no voters:
I20260619 02:47:17.055215 27638 raft_consensus.cc:2781] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:17.055397 27638 raft_consensus.cc:686] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 LEADER]: Becoming Leader. State: Replica: de1fbd9c9dd74483a110f1f9ea2ff5ff, State: Running, Role: LEADER
I20260619 02:47:17.055491 27638 consensus_queue.cc:237] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:17.056291 27164 catalog_manager.cc:5495] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff reported cstate change: term changed from 0 to 1, leader changed from <none> to de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66). New cstate: current_term: 1 leader_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } health_report { overall_health: UNKNOWN } } }
I20260619 02:47:17.066493 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.064147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34104 (local address 127.12.145.66:34097)
0619 02:47:17.064208 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:17.064210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:17.064225 (+ 15us) server_negotiation.cc:407] Connection header received
0619 02:47:17.064271 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:17.064272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:17.064289 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:17.064368 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:47:17.064465 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.064928 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.065679 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:17.065881 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:17.065963 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:17.066140 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:47:17.066256 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:47:17.066360 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:17.066377 (+ 17us) server_negotiation.cc:299] Negotiation successful
0619 02:47:17.066397 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260619 02:47:17.068148 27307 raft_consensus.cc:1261] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Refusing update from remote peer de1fbd9c9dd74483a110f1f9ea2ff5ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:17.068173 27577 raft_consensus.cc:1261] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 1 FOLLOWER]: Refusing update from remote peer de1fbd9c9dd74483a110f1f9ea2ff5ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:17.068462 27638 consensus_queue.cc:1035] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:17.068596 27640 consensus_queue.cc:1035] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:17.071004 27645 mvcc.cc:205] Tried to move back new op lower bound from 7298405323028869120 to 7298405322979872768. Current Snapshot: MvccSnapshot[applied={T|T < 7298405323028869120}]
I20260619 02:47:17.072837 27164 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:44508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:17.072928 27164 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:44508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:17.073606 27164 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Sending DeleteTablet for 3 replicas of tablet d671596735e6443696e9e5941006741a
I20260619 02:47:17.073879 27557 tablet_service.cc:1514] Processing DeleteTablet for tablet d671596735e6443696e9e5941006741a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:17 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:49646
I20260619 02:47:17.073915 27287 tablet_service.cc:1514] Processing DeleteTablet for tablet d671596735e6443696e9e5941006741a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:17 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34908
I20260619 02:47:17.073945 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 27202
I20260619 02:47:17.073995 27362 tablet_replica.cc:330] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: stopping tablet replica
I20260619 02:47:17.074048 27362 raft_consensus.cc:2229] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:17.074100 27362 raft_consensus.cc:2258] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:17.074599 27652 tablet_replica.cc:330] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: stopping tablet replica
I20260619 02:47:17.074682 27652 raft_consensus.cc:2229] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:17.074765 27652 raft_consensus.cc:2258] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:17.075464 27425 tablet_service.cc:1514] Processing DeleteTablet for tablet d671596735e6443696e9e5941006741a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:17 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34094
I20260619 02:47:17.075685 27653 tablet_replica.cc:330] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: stopping tablet replica
I20260619 02:47:17.075819 27653 raft_consensus.cc:2229] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:47:17.075958 27653 raft_consensus.cc:2258] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:17.076040 27652 ts_tablet_manager.cc:1905] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:17.076516 27653 ts_tablet_manager.cc:1905] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:17.078168 27653 ts_tablet_manager.cc:1918] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:17.078176 27652 ts_tablet_manager.cc:1918] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:17.078239 27652 log.cc:1196] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/d671596735e6443696e9e5941006741a
I20260619 02:47:17.078341 27653 log.cc:1196] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/d671596735e6443696e9e5941006741a
I20260619 02:47:17.078508 27652 ts_tablet_manager.cc:1939] T d671596735e6443696e9e5941006741a P 4bd5a5ce8b17467782359d925b886b50: Deleting consensus metadata
I20260619 02:47:17.078784 27653 ts_tablet_manager.cc:1939] T d671596735e6443696e9e5941006741a P de1fbd9c9dd74483a110f1f9ea2ff5ff: Deleting consensus metadata
I20260619 02:47:17.079000 27148 catalog_manager.cc:4841] TS 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555): tablet d671596735e6443696e9e5941006741a (table test-table [id=294d226a44cc47da8d1f08415db87ec1]) successfully deleted
I20260619 02:47:17.079290 27148 catalog_manager.cc:4841] TS de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097): tablet d671596735e6443696e9e5941006741a (table test-table [id=294d226a44cc47da8d1f08415db87ec1]) successfully deleted
W20260619 02:47:17.080407 27151 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:41189 (error 108)
I20260619 02:47:17.080698 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 27358
I20260619 02:47:17.081341 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.080799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41189 (local address 127.0.0.1:34914)
0619 02:47:17.081264 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.081305 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:41189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444}
W20260619 02:47:17.081470 27151 catalog_manager.cc:4584] TS 48e494fb367349b4803d0ff72c4baed5 (127.12.145.65:41189): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d671596735e6443696e9e5941006741a: Network error: Client connection negotiation failed: client connection to 127.12.145.65:41189: connect: Connection refused (error 111)
I20260619 02:47:17.086306 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 27494
I20260619 02:47:17.090695 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 27131
I20260619 02:47:17.095523 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39467
--webserver_interface=127.12.145.126
--webserver_port=32791
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:39467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:17.176685 27655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:17.176882 27655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:17.176911 27655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:17.178085 27655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:17.178128 27655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:17.178141 27655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:17.178159 27655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:17.178215 27655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:17.179718 27655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:39467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:39467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:17.179981 27655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:17.180205 27655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:17.184966 27661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:17.184967 27660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:17.184949 27663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:17.185185 27655 server_base.cc:1034] running on GCE node
I20260619 02:47:17.185405 27655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:17.185650 27655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:17.186815 27655 hybrid_clock.cc:648] HybridClock initialized: now 1781837237186802 us; error 31 us; skew 500 ppm
Jun 19 02:47:17 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837237, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:17.193131 27655 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:17.193576 27655 webserver.cc:460] Webserver started at http://127.12.145.126:32791/ using document root <none> and password file <none>
I20260619 02:47:17.193817 27655 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:17.193886 27655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:17.195308 27655 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:17.195966 27670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.196161 27655 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:47:17.196259 27655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "7c351bcdd3a44f1f84d18def60e18647"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "eb61cf92cf9bb498e5a604570ec41183"
server_key_iv: "ce08e265b8ce2399ea501773ee9b7281"
server_key_version: "encryptionkey@0"
I20260619 02:47:17.196622 27655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:17.224243 27655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:17.226660 27655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:17.226778 27655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:17.230505 27655 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:39467
I20260619 02:47:17.230588 27722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:39467 every 8 connection(s)
I20260619 02:47:17.230978 27655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:17.232519 27723 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:47:17.233158 27723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Bootstrap starting.
I20260619 02:47:17.240690 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 27655
I20260619 02:47:17.241012 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:41189
--local_ip_for_outbound_sockets=127.12.145.65
--tserver_master_addrs=127.12.145.126:39467
--webserver_port=45109
--webserver_interface=127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:17.241500 27723 log.cc:824] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:17.243901 27723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:47:17.244218 27723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647: Bootstrap complete.
I20260619 02:47:17.246482 27723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:17.246802 27723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c351bcdd3a44f1f84d18def60e18647, State: Initialized, Role: FOLLOWER
I20260619 02:47:17.247020 27723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:17.247103 27723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:17.247155 27723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:17.247203 27723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 2 FOLLOWER]: Advancing to term 3
I20260619 02:47:17.248159 27723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:17.248281 27723 leader_election.cc:302] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c351bcdd3a44f1f84d18def60e18647; no voters:
I20260619 02:47:17.248492 27723 leader_election.cc:288] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260619 02:47:17.248526 27727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 02:47:17.248634 27727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [term 3 LEADER]: Becoming Leader. State: Replica: 7c351bcdd3a44f1f84d18def60e18647, State: Running, Role: LEADER
I20260619 02:47:17.248751 27723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:17.248724 27727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } }
I20260619 02:47:17.249029 27727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c351bcdd3a44f1f84d18def60e18647. Latest consensus state: current_term: 3 leader_uuid: "7c351bcdd3a44f1f84d18def60e18647" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } } }
I20260619 02:47:17.249090 27727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:17.249298 27731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:17.249384 27729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7c351bcdd3a44f1f84d18def60e18647" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c351bcdd3a44f1f84d18def60e18647" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 39467 } } }
I20260619 02:47:17.249538 27729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c351bcdd3a44f1f84d18def60e18647 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:17.250149 27731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:17.250268 27731 catalog_manager.cc:1259] Loaded cluster ID: f1ec95da24594b0b9b794965a9d3502a
I20260619 02:47:17.250309 27731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260619 02:47:17.250609 27731 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f612ec199ad google::LogMessage::Fail() at ??:0
@ 0x7f612ec1c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f612ec194de google::LogMessage::Flush() at ??:0
@ 0x7f612ec1aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6136b3a0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f6136b438b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6130ae70d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6130adc954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f61319406db start_thread at ??:0
@ 0x7f612d71761f clone at ??:0
W20260619 02:47:17.336913 27726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:17.337116 27726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:17.337141 27726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:17.338310 27726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:17.338351 27726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:17.338376 27726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:47:17.339864 27726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:41189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=45109
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:17.340130 27726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:17.340385 27726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:17.345329 27759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:17.345341 27762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:17.345589 27726 server_base.cc:1034] running on GCE node
W20260619 02:47:17.345310 27760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:17.345899 27726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:17.346200 27726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:17.347386 27726 hybrid_clock.cc:648] HybridClock initialized: now 1781837237347362 us; error 38 us; skew 500 ppm
Jun 19 02:47:17 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837237, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:17.350284 27726 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:47:17.350821 27726 webserver.cc:460] Webserver started at http://127.12.145.65:45109/ using document root <none> and password file <none>
I20260619 02:47:17.351068 27726 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:17.351138 27726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:17.352551 27726 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:17.353300 27769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.353536 27726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:17.353647 27726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "48e494fb367349b4803d0ff72c4baed5"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "1caa79fdcf7706980d99f253ad517ee5"
server_key_iv: "5d08fb46b03e920642c5d6c90f0d6c22"
server_key_version: "encryptionkey@0"
I20260619 02:47:17.354007 27726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:17.379704 27726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:17.382166 27726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:17.382336 27726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:17.382644 27726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:17.383128 27776 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260619 02:47:17.385088 27726 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 02:47:17.385150 27726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260619 02:47:17.385195 27726 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 02:47:17.385843 27726 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 02:47:17.385903 27726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:17.385982 27776 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Bootstrap starting.
I20260619 02:47:17.393216 27726 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:41189
I20260619 02:47:17.393358 27883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:41189 every 8 connection(s)
I20260619 02:47:17.393673 27726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:47:17.396878 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 27726
I20260619 02:47:17.397171 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:34097
--local_ip_for_outbound_sockets=127.12.145.66
--tserver_master_addrs=127.12.145.126:39467
--webserver_port=32923
--webserver_interface=127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:17.397172 27776 log.cc:824] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:17.399953 27776 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:47:17.400264 27776 tablet_bootstrap.cc:492] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Bootstrap complete.
I20260619 02:47:17.401504 27776 ts_tablet_manager.cc:1397] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260619 02:47:17.402992 27776 raft_consensus.cc:348] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:17.403323 27776 raft_consensus.cc:729] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48e494fb367349b4803d0ff72c4baed5, State: Initialized, Role: FOLLOWER
I20260619 02:47:17.403512 27776 consensus_queue.cc:260] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:17.403802 27776 ts_tablet_manager.cc:1428] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260619 02:47:17.433612 27886 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:47:17.394358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:47515)
0619 02:47:17.394532 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.394623 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:17.395094 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:17.433400 (+ 38306us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
W20260619 02:47:17.433884 27884 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:39467 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.126:39467: Client connection negotiation failed: client connection to 127.12.145.126:39467: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 02:47:17.434240 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.434097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:60179)
0619 02:47:17.434164 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.434215 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260619 02:47:17.434628 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.434510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:41513)
0619 02:47:17.434579 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.434604 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 02:47:17.434749 27884 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 02:47:17.480472 27888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:17.480705 27888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:17.480742 27888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:17.481900 27888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:17.481968 27888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:17.482014 27888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:47:17.483578 27888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:34097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=32923
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:17.483901 27888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:17.484163 27888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:17.489027 27897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:17.489032 27895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:17.489235 27888 server_base.cc:1034] running on GCE node
W20260619 02:47:17.489074 27894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:17.489526 27888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:17.489720 27888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:17.490892 27888 hybrid_clock.cc:648] HybridClock initialized: now 1781837237490881 us; error 30 us; skew 500 ppm
Jun 19 02:47:17 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837237, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:17.493340 27888 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:47:17.493799 27888 webserver.cc:460] Webserver started at http://127.12.145.66:32923/ using document root <none> and password file <none>
I20260619 02:47:17.494011 27888 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:17.494062 27888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:17.495424 27888 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:17.496004 27904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.496181 27888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:47:17.496269 27888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff"
format_stamp: "Formatted at 2026-06-19 02:47:15 on dist-test-slave-fbl4"
server_key: "c6aa33ee140d6c600ddf9a0335179848"
server_key_iv: "f971256319d8a69b5939dd4a2c6b8ea1"
server_key_version: "encryptionkey@0"
I20260619 02:47:17.496592 27888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:17.515072 27888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:17.517318 27888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:17.517472 27888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:17.517683 27888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:17.518002 27888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:17.518069 27888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.518106 27888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:17.518136 27888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.523706 27888 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34097
I20260619 02:47:17.523759 28017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34097 every 8 connection(s)
I20260619 02:47:17.524078 27888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:47:17.525055 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.524710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:56823)
0619 02:47:17.524849 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.524922 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
W20260619 02:47:17.525460 28018 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:39467 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.126:39467: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
I20260619 02:47:17.525733 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.525649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:37881)
0619 02:47:17.525692 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.525717 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260619 02:47:17.526051 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.525976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:53171)
0619 02:47:17.526017 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.526038 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260619 02:47:17.526167 28018 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 02:47:17.532358 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 27888
I20260619 02:47:17.532600 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:38555
--local_ip_for_outbound_sockets=127.12.145.67
--tserver_master_addrs=127.12.145.126:39467
--webserver_port=39959
--webserver_interface=127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:17.613849 28021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:17.614041 28021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:17.614064 28021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:17.615123 28021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:17.615159 28021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:17.615185 28021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:47:17.616523 28021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:38555
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=39959
--tserver_master_addrs=127.12.145.126:39467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:17.616693 28021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:17.616851 28021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:17.621522 28029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:17.621496 28026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:17.621491 28027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:17.621778 28021 server_base.cc:1034] running on GCE node
I20260619 02:47:17.621996 28021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:17.622225 28021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:17.623380 28021 hybrid_clock.cc:648] HybridClock initialized: now 1781837237623369 us; error 35 us; skew 500 ppm
Jun 19 02:47:17 dist-test-slave-fbl4 krb5kdc[26587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837237, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:17.625852 28021 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:47:17.626320 28021 webserver.cc:460] Webserver started at http://127.12.145.67:39959/ using document root <none> and password file <none>
I20260619 02:47:17.626502 28021 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:17.626587 28021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:17.627967 28021 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:47:17.628566 28036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.628780 28021 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:47:17.628876 28021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "4bd5a5ce8b17467782359d925b886b50"
format_stamp: "Formatted at 2026-06-19 02:47:16 on dist-test-slave-fbl4"
server_key: "552a8677d829c81961de3e4d3ec69131"
server_key_iv: "b0909e60baf64be69de3b3d42eeb501e"
server_key_version: "encryptionkey@0"
I20260619 02:47:17.629200 28021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:17.646842 28021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:17.648599 28021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:17.648751 28021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:17.648968 28021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:17.649251 28021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:17.649304 28021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.649344 28021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:17.649369 28021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:17.655026 28021 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:38555
I20260619 02:47:17.655073 28149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:38555 every 8 connection(s)
I20260619 02:47:17.655418 28021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:47:17.656445 28152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.656043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:44533)
0619 02:47:17.656240 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.656311 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":134,"threads_started":1}
W20260619 02:47:17.656843 28150 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:39467 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.126:39467: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
I20260619 02:47:17.657114 28152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.657024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:58691)
0619 02:47:17.657067 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.657095 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260619 02:47:17.657425 28152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:17.657353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:40959)
0619 02:47:17.657390 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:17.657412 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260619 02:47:17.657593 28150 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 02:47:17.657698 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28021
I20260619 02:47:18.435264 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:18.435044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:44183)
0619 02:47:18.435172 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:18.435206 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":56,"threads_started":1}
I20260619 02:47:18.526695 28155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:18.526458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:54881)
0619 02:47:18.526619 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:18.526651 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":53,"threads_started":1}
I20260619 02:47:18.658102 28156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:18.657901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:46871)
0619 02:47:18.658026 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:18.658058 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":56,"threads_started":1}
I20260619 02:47:18.681114 28157 raft_consensus.cc:482] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:18.681221 28157 raft_consensus.cc:504] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:18.681489 28157 leader_election.cc:288] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555), de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097)
Jun 19 02:47:18 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837237, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.66@KRBTEST.COM
Jun 19 02:47:18 dist-test-slave-fbl4 krb5kdc[26587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837237, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.67@KRBTEST.COM
I20260619 02:47:18.693917 28160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:18.681979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:44175 (local address 127.12.145.66:34097)
0619 02:47:18.682171 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:18.682177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:18.682203 (+ 26us) server_negotiation.cc:407] Connection header received
0619 02:47:18.682732 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:18.682735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:18.682773 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:18.682889 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:18.683843 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.685236 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.686781 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.687405 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.687525 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:18.690235 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:18.690239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:18.690239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:18.690270 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:18.692145 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:18.692622 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:18.692625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:18.692625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:18.692736 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:18.693043 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:18.693044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:18.693044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:18.693298 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:18.693359 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:18.693698 (+ 339us) server_negotiation.cc:299] Negotiation successful
0619 02:47:18.693818 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":84,"threads_started":1}
I20260619 02:47:18.693904 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:18.681735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:38555 (local address 127.12.145.65:53981)
0619 02:47:18.681810 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:18.681824 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:18.681894 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:18.682963 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:18.682966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:18.683453 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:18.683713 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:18.683721 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.685383 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.685384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:18.686691 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:18.686693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.687513 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.687514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:18.687678 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:18.688306 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:18.688309 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:18.690482 (+ 2173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:18.692334 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:18.692335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:18.692335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:18.692633 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:18.692964 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:18.692965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:18.692965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:18.693041 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:18.693429 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:18.693430 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:18.693513 (+ 83us) client_negotiation.cc:769] Sending connection context
0619 02:47:18.693596 (+ 83us) client_negotiation.cc:240] Negotiation successful
0619 02:47:18.693784 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":77}
I20260619 02:47:18.693928 28158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:18.681839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:53981 (local address 127.12.145.67:38555)
0619 02:47:18.682026 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:18.682038 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:18.682074 (+ 36us) server_negotiation.cc:407] Connection header received
0619 02:47:18.682672 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:18.682676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:18.682734 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:18.682886 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:18.683843 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.685236 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.686781 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.687405 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.687517 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:18.690597 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:18.690600 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:18.690600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:18.690611 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:18.692243 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:18.692705 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:18.692746 (+ 41us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:18.692746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:18.692891 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:18.693110 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:18.693111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:18.693111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:18.693317 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:18.693430 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:18.693673 (+ 243us) server_negotiation.cc:299] Negotiation successful
0619 02:47:18.693815 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":54,"threads_started":1}
I20260619 02:47:18.694010 28159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:18.681896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34097 (local address 127.12.145.65:44175)
0619 02:47:18.681984 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:18.681994 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:18.682059 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:18.682963 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:18.682966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:18.683453 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:18.683713 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:18.683721 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.685375 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.685376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:18.686691 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:18.686693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:18.687515 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:18.687515 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:18.687679 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:18.688291 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:18.688302 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:18.690137 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:18.692236 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:18.692243 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:18.692245 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:18.692540 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:18.692810 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:18.692811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:18.692811 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:18.692977 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:18.693381 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:18.693387 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:18.693517 (+ 130us) client_negotiation.cc:769] Sending connection context
0619 02:47:18.693636 (+ 119us) client_negotiation.cc:240] Negotiation successful
0619 02:47:18.693864 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":175,"thread_start_us":53,"threads_started":1}
W20260619 02:47:18.694691 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555): Not found: Tablet not found: d671596735e6443696e9e5941006741a
W20260619 02:47:18.695389 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097): Not found: Tablet not found: d671596735e6443696e9e5941006741a
I20260619 02:47:18.695431 27770 leader_election.cc:302] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5; no voters: 4bd5a5ce8b17467782359d925b886b50, de1fbd9c9dd74483a110f1f9ea2ff5ff
I20260619 02:47:18.695538 28157 raft_consensus.cc:2726] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:47:19.435927 28161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:19.435724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:47969)
0619 02:47:19.435847 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:19.435881 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":68,"threads_started":1}
I20260619 02:47:19.527369 28162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:19.527144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:39471)
0619 02:47:19.527280 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:19.527319 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":59,"threads_started":1}
I20260619 02:47:19.658741 28163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:19.658509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:54857)
0619 02:47:19.658675 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:19.658706 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":114,"threads_started":1}
I20260619 02:47:20.290735 28164 raft_consensus.cc:482] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:20.290812 28164 raft_consensus.cc:504] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:20.290967 28164 leader_election.cc:288] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555), de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097)
W20260619 02:47:20.291411 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555): Not found: Tablet not found: d671596735e6443696e9e5941006741a
W20260619 02:47:20.291518 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097): Not found: Tablet not found: d671596735e6443696e9e5941006741a
I20260619 02:47:20.291556 27770 leader_election.cc:302] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5; no voters: 4bd5a5ce8b17467782359d925b886b50, de1fbd9c9dd74483a110f1f9ea2ff5ff
I20260619 02:47:20.291654 28164 raft_consensus.cc:2726] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:47:20.436533 28165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:20.436340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:52083)
0619 02:47:20.436452 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:20.436485 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260619 02:47:20.527959 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:20.527780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:42873)
0619 02:47:20.527893 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:20.527924 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":73,"threads_started":1}
I20260619 02:47:20.659329 28167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:20.659151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:51847)
0619 02:47:20.659259 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:20.659293 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260619 02:47:21.437175 28168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:21.436970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:41327)
0619 02:47:21.437094 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:21.437129 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260619 02:47:21.528489 28169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:21.528295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:48771)
0619 02:47:21.528409 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:21.528440 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
I20260619 02:47:21.659929 28170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:21.659722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:45375)
0619 02:47:21.659849 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:21.659886 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260619 02:47:22.437829 28171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:22.437638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:55455)
0619 02:47:22.437755 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:22.437786 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260619 02:47:22.529044 28172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:22.528864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:54605)
0619 02:47:22.528974 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:22.529003 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":56,"threads_started":1}
I20260619 02:47:22.660487 28173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:22.660300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:53855)
0619 02:47:22.660410 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:22.660446 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260619 02:47:22.714200 28174 raft_consensus.cc:482] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:22.714293 28174 raft_consensus.cc:504] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:22.714416 28174 leader_election.cc:288] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555), de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097)
W20260619 02:47:22.714915 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097): Not found: Tablet not found: d671596735e6443696e9e5941006741a
W20260619 02:47:22.715004 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555): Not found: Tablet not found: d671596735e6443696e9e5941006741a
I20260619 02:47:22.715056 27770 leader_election.cc:302] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5; no voters: 4bd5a5ce8b17467782359d925b886b50, de1fbd9c9dd74483a110f1f9ea2ff5ff
I20260619 02:47:22.715153 28174 raft_consensus.cc:2726] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:47:23.438455 28175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:23.438256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:35725)
0619 02:47:23.438374 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:23.438408 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
I20260619 02:47:23.529752 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:23.529547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:43149)
0619 02:47:23.529660 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:23.529713 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":54,"threads_started":1}
I20260619 02:47:23.661168 28177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:23.660966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:59099)
0619 02:47:23.661098 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:23.661131 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":60,"threads_started":1}
I20260619 02:47:24.439100 28178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:24.438886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:40279)
0619 02:47:24.439023 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:24.439054 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260619 02:47:24.530372 28179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:24.530174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:32791)
0619 02:47:24.530299 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:24.530333 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260619 02:47:24.661747 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:24.661571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:46109)
0619 02:47:24.661678 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:24.661709 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":55,"threads_started":1}
I20260619 02:47:25.439782 28181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:25.439556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:57833)
0619 02:47:25.439670 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:25.439705 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260619 02:47:25.531020 28182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:25.530824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:56555)
0619 02:47:25.530949 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:25.530983 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":55,"threads_started":1}
I20260619 02:47:25.662312 28183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:25.662108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:48625)
0619 02:47:25.662236 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:25.662272 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":54,"threads_started":1}
I20260619 02:47:26.362358 28184 raft_consensus.cc:482] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:26.362465 28184 raft_consensus.cc:504] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:26.362653 28184 leader_election.cc:288] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555), de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097)
W20260619 02:47:26.363085 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555): Not found: Tablet not found: d671596735e6443696e9e5941006741a
W20260619 02:47:26.363160 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097): Not found: Tablet not found: d671596735e6443696e9e5941006741a
I20260619 02:47:26.363178 27770 leader_election.cc:302] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5; no voters: 4bd5a5ce8b17467782359d925b886b50, de1fbd9c9dd74483a110f1f9ea2ff5ff
I20260619 02:47:26.363278 28184 raft_consensus.cc:2726] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:47:26.440655 28185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:26.440374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:50655)
0619 02:47:26.440549 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:26.440595 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":125,"threads_started":1}
I20260619 02:47:26.531709 28186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:26.531466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:50919)
0619 02:47:26.531607 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:26.531648 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":58,"threads_started":1}
I20260619 02:47:26.663066 28187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:26.662814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:43347)
0619 02:47:26.662971 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:26.663006 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260619 02:47:27.441437 28188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:27.441177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:57631)
0619 02:47:27.441333 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:27.441381 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":74,"threads_started":1}
I20260619 02:47:27.532454 28189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:27.532226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:57401)
0619 02:47:27.532366 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:27.532405 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260619 02:47:27.663699 28190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:27.663516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:40171)
0619 02:47:27.663624 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:27.663657 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":54,"threads_started":1}
I20260619 02:47:28.442113 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:28.441883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:39449)
0619 02:47:28.442008 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:28.442055 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
I20260619 02:47:28.533123 28192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:28.532920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:42773)
0619 02:47:28.533042 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:28.533078 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260619 02:47:28.664397 28193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:28.664218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:33069)
0619 02:47:28.664330 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:28.664359 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":65,"threads_started":1}
I20260619 02:47:29.442800 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:29.442605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:33277)
0619 02:47:29.442719 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:29.442753 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260619 02:47:29.533825 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:29.533624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:55323)
0619 02:47:29.533745 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:29.533779 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260619 02:47:29.665088 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:29.664872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:47403)
0619 02:47:29.665001 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:29.665043 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260619 02:47:29.872308 28197 raft_consensus.cc:482] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:29.872403 28197 raft_consensus.cc:504] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bd5a5ce8b17467782359d925b886b50" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 38555 } } peers { permanent_uuid: "de1fbd9c9dd74483a110f1f9ea2ff5ff" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34097 } } peers { permanent_uuid: "48e494fb367349b4803d0ff72c4baed5" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41189 } }
I20260619 02:47:29.872566 28197 leader_election.cc:288] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555), de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097)
W20260619 02:47:29.872925 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer de1fbd9c9dd74483a110f1f9ea2ff5ff (127.12.145.66:34097): Not found: Tablet not found: d671596735e6443696e9e5941006741a
W20260619 02:47:29.873142 27770 leader_election.cc:341] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4bd5a5ce8b17467782359d925b886b50 (127.12.145.67:38555): Not found: Tablet not found: d671596735e6443696e9e5941006741a
I20260619 02:47:29.873181 27770 leader_election.cc:302] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48e494fb367349b4803d0ff72c4baed5; no voters: 4bd5a5ce8b17467782359d925b886b50, de1fbd9c9dd74483a110f1f9ea2ff5ff
I20260619 02:47:29.873246 28197 raft_consensus.cc:2726] T d671596735e6443696e9e5941006741a P 48e494fb367349b4803d0ff72c4baed5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:47:30.443517 28198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:30.443265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:35535)
0619 02:47:30.443408 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:30.443471 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":66,"threads_started":1}
I20260619 02:47:30.534459 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:30.534252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:44255)
0619 02:47:30.534380 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:30.534417 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":60,"threads_started":1}
I20260619 02:47:30.665822 28200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:30.665563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:53165)
0619 02:47:30.665708 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:30.665754 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260619 02:47:31.444341 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:31.444104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:59107)
0619 02:47:31.444252 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:31.444291 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":75,"threads_started":1}
I20260619 02:47:31.535079 28202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:31.534880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:60639)
0619 02:47:31.535000 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:31.535034 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":71,"threads_started":1}
I20260619 02:47:31.666447 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:31.666247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:42913)
0619 02:47:31.666367 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:31.666401 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260619 02:47:32.445039 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:32.444820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.65:50933)
0619 02:47:32.444948 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:32.444981 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":60,"threads_started":1}
I20260619 02:47:32.535693 28205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:32.535511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.66:37245)
0619 02:47:32.535619 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:32.535649 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260619 02:47:32.666905 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 27726
I20260619 02:47:32.667765 28206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:32.666950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:39467 (local address 127.12.145.67:58675)
0619 02:47:32.667672 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:32.667711 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:39467: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":62,"threads_started":1}
I20260619 02:47:32.672039 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 27888
I20260619 02:47:32.677057 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28021
2026-06-19T02:47:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18320 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:47:32 dist-test-slave-fbl4 krb5kdc[28209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:47:32 dist-test-slave-fbl4 krb5kdc[28209](info): set up 2 sockets
Jun 19 02:47:32 dist-test-slave-fbl4 krb5kdc[28209](info): commencing operation
krb5kdc: starting...
W20260619 02:47:33.726869 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:47:33 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:47:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:47:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:47:33.843609 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36035
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:36035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:33.923240 28222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:33.923444 28222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:33.923465 28222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:33.924629 28222 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 02:47:33.924670 28222 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 02:47:33.924685 28222 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 02:47:33.924696 28222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:33.924734 28222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:33.924768 28222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:33.924784 28222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:33.924808 28222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:33.926278 28222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:36035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:33.926528 28222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:33.926800 28222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:33.932004 28227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:33.932016 28228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:33.932041 28222 server_base.cc:1034] running on GCE node
W20260619 02:47:33.932020 28230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:33.932453 28222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:33.932751 28222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:33.933921 28222 hybrid_clock.cc:648] HybridClock initialized: now 1781837253933915 us; error 38 us; skew 500 ppm
Jun 19 02:47:33 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:33.936406 28222 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:33.936870 28222 webserver.cc:460] Webserver started at http://127.12.145.126:33145/ using document root <none> and password file <none>
I20260619 02:47:33.937114 28222 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:33.937183 28222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:33.937330 28222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:33.938408 28222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "4e6c45007da8447ab29389d31fb24211"
format_stamp: "Formatted at 2026-06-19 02:47:33 on dist-test-slave-fbl4"
server_key: "f4e92b3eba28a35ff539acff23d71e29"
server_key_iv: "cedf38294f58807253dcff23a5fe1d08"
server_key_version: "encryptionkey@0"
I20260619 02:47:33.938778 28222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "4e6c45007da8447ab29389d31fb24211"
format_stamp: "Formatted at 2026-06-19 02:47:33 on dist-test-slave-fbl4"
server_key: "f4e92b3eba28a35ff539acff23d71e29"
server_key_iv: "cedf38294f58807253dcff23a5fe1d08"
server_key_version: "encryptionkey@0"
I20260619 02:47:33.940078 28222 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:47:33.940814 28237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:33.940999 28222 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:47:33.941100 28222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "4e6c45007da8447ab29389d31fb24211"
format_stamp: "Formatted at 2026-06-19 02:47:33 on dist-test-slave-fbl4"
server_key: "f4e92b3eba28a35ff539acff23d71e29"
server_key_iv: "cedf38294f58807253dcff23a5fe1d08"
server_key_version: "encryptionkey@0"
I20260619 02:47:33.941171 28222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:33.954900 28222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:33.956950 28222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:33.957129 28222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:33.961170 28222 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:36035
I20260619 02:47:33.961199 28289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:36035 every 8 connection(s)
I20260619 02:47:33.961552 28222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:33.962432 28290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:33.964692 28290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Bootstrap starting.
I20260619 02:47:33.965216 28290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:33.965456 28290 log.cc:824] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:33.966113 28290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: No bootstrap required, opened a new log
I20260619 02:47:33.967808 28290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:33.967943 28290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:33.967965 28290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e6c45007da8447ab29389d31fb24211, State: Initialized, Role: FOLLOWER
I20260619 02:47:33.967988 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28222
I20260619 02:47:33.968139 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:47:33.968160 28290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:33.968257 28290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:33.968288 28290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:33.968350 28290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:33.968361 12869 external_mini_cluster.cc:1428] Setting key dec3011490028975df1386d509fd3403
I20260619 02:47:33.969086 28290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:33.969195 28290 leader_election.cc:302] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e6c45007da8447ab29389d31fb24211; no voters:
I20260619 02:47:33.969367 28290 leader_election.cc:288] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:47:33.969396 28294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:33.969568 28294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 LEADER]: Becoming Leader. State: Replica: 4e6c45007da8447ab29389d31fb24211, State: Running, Role: LEADER
I20260619 02:47:33.969699 28290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:33.969697 28294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:33.970937 28297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e6c45007da8447ab29389d31fb24211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } } }
I20260619 02:47:33.971041 28297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:33.971458 28296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e6c45007da8447ab29389d31fb24211. Latest consensus state: current_term: 1 leader_uuid: "4e6c45007da8447ab29389d31fb24211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } } }
I20260619 02:47:33.971552 28296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: This master's current role is: LEADER
W20260619 02:47:33.971807 28309 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:47:33.971884 28309 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:47:33.971977 28310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:33.972187 28310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:33.973615 28310 catalog_manager.cc:1347] Generated new cluster ID: c91bf6f6f0164328bed697db7b9098f1
I20260619 02:47:33.973667 28310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:47:33 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:33.980963 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:33.968841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52254 (local address 127.12.145.126:36035)
0619 02:47:33.969458 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:33.969467 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:33.969517 (+ 50us) server_negotiation.cc:407] Connection header received
0619 02:47:33.969636 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:33.969642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:33.969722 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:33.969850 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:33.970694 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:33.972232 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:33.973302 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:33.973909 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:33.974020 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:33.976865 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:33.976868 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:33.976868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:33.976878 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:33.979355 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:33.979755 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:33.979757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:33.979758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:33.979864 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:33.980077 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:33.980078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:33.980078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:33.980359 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:33.980479 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:33.980635 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 02:47:33.980760 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":490,"threads_started":1}
I20260619 02:47:33.986660 28310 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:47:33.987232 28310 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:33.990833 28310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Generated new TSK 0
I20260619 02:47:33.991001 28310 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:47:34.025453 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36035
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:34.117723 28316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:34.117931 28316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:34.117955 28316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:34.119141 28316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:34.119184 28316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:34.119210 28316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:47:34.120666 28316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:34.120853 28316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:34.121026 28316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:34.126102 28324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:34.126107 28321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:34.126124 28316 server_base.cc:1034] running on GCE node
W20260619 02:47:34.126093 28322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:34.126470 28316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:34.126782 28316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:34.127964 28316 hybrid_clock.cc:648] HybridClock initialized: now 1781837254127952 us; error 30 us; skew 500 ppm
Jun 19 02:47:34 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837254, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:34.130489 28316 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:47:34.131004 28316 webserver.cc:460] Webserver started at http://127.12.145.65:46573/ using document root <none> and password file <none>
I20260619 02:47:34.131234 28316 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:34.131300 28316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:34.131583 28316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:34.132664 28316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "475414214c3c47fe8009cf9e7cf263ac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "9f2b99aaa0a431910fd8ea4c6959a43d"
server_key_iv: "295d0ab1d90748d574109b7ec4335488"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.133026 28316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "475414214c3c47fe8009cf9e7cf263ac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "9f2b99aaa0a431910fd8ea4c6959a43d"
server_key_iv: "295d0ab1d90748d574109b7ec4335488"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.134452 28316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:47:34.135298 28331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.135480 28316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:34.135581 28316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "475414214c3c47fe8009cf9e7cf263ac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "9f2b99aaa0a431910fd8ea4c6959a43d"
server_key_iv: "295d0ab1d90748d574109b7ec4335488"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.135671 28316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:34.145507 28316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:34.147581 28316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:34.147739 28316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:34.147970 28316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:34.148265 28316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:34.148322 28316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.148363 28316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:34.148391 28316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.154269 28316 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:33279
I20260619 02:47:34.154309 28444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:33279 every 8 connection(s)
I20260619 02:47:34.154729 28316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:47:34 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837254, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:34.161149 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28316
I20260619 02:47:34.161312 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:47:34.161538 12869 external_mini_cluster.cc:1428] Setting key b501b3808a8e1bbb25f2c06643738e17
I20260619 02:47:34.164215 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.155472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:43559 (local address 127.12.145.126:36035)
0619 02:47:34.155522 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.155524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.155715 (+ 191us) server_negotiation.cc:407] Connection header received
0619 02:47:34.156190 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.156191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.156201 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.156265 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:34.157162 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.157698 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.158725 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.158922 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.158977 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.161127 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:34.161128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:34.161128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:34.161137 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:34.162783 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.163199 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.163200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.163201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.163259 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.163548 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.163549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.163549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.163689 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:34.163749 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.164084 (+ 335us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.164151 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:47:34.164494 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.155438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:43559)
0619 02:47:34.155585 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.155627 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.156108 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.156322 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.156325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.156881 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:34.157075 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.157079 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.157780 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.157781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.158644 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.158646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.158994 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.158995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.159091 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.159561 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:34.159569 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:34.161037 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:34.162871 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:34.162878 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:34.162880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:34.163107 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:34.163327 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:34.163328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:34.163328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:34.163464 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:34.163759 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:34.163765 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:34.163942 (+ 177us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.164062 (+ 120us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.164237 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260619 02:47:34.164919 28445 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36035
I20260619 02:47:34.165009 28445 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:34.165194 28445 heartbeater.cc:511] Master 127.12.145.126:36035 requested a full tablet report, sending...
I20260619 02:47:34.165710 28254 ts_manager.cc:194] Registered new tserver with Master: 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279)
I20260619 02:47:34.166311 28254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:43559
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:47:34.185349 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36035
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:34.266070 28450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:34.266265 28450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:34.266289 28450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:34.267495 28450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:34.267540 28450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:34.267567 28450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:47:34.268934 28450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:34.269121 28450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:34.269289 28450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:34.274542 28455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:34.274576 28458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:34.274755 28450 server_base.cc:1034] running on GCE node
W20260619 02:47:34.274637 28456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:34.275064 28450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:34.275307 28450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:34.276507 28450 hybrid_clock.cc:648] HybridClock initialized: now 1781837254276484 us; error 37 us; skew 500 ppm
Jun 19 02:47:34 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837254, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:34.279042 28450 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:47:34.279421 28450 webserver.cc:460] Webserver started at http://127.12.145.66:45867/ using document root <none> and password file <none>
I20260619 02:47:34.279616 28450 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:34.279655 28450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:34.279785 28450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:34.280784 28450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "9da83e06ae2b461d930b30cf00dc6dac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "cec90ddd92c49f1d0f02b2b86b3ccf38"
server_key_iv: "bbbc9282033c8dbd23b924f14bd82cec"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.281073 28450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "9da83e06ae2b461d930b30cf00dc6dac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "cec90ddd92c49f1d0f02b2b86b3ccf38"
server_key_iv: "bbbc9282033c8dbd23b924f14bd82cec"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.282305 28450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:47:34.283104 28465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.283324 28450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:34.283428 28450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "9da83e06ae2b461d930b30cf00dc6dac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "cec90ddd92c49f1d0f02b2b86b3ccf38"
server_key_iv: "bbbc9282033c8dbd23b924f14bd82cec"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.283512 28450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:34.308039 28450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:34.310200 28450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:34.310359 28450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:34.310626 28450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:34.310928 28450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:34.310981 28450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.311015 28450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:34.311061 28450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.316814 28450 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34895
I20260619 02:47:34.316860 28578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34895 every 8 connection(s)
I20260619 02:47:34.317175 28450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:47:34.320436 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28450
I20260619 02:47:34.320556 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:47:34.320752 12869 external_mini_cluster.cc:1428] Setting key e4e327f7b8eeb537252898924116e512
Jun 19 02:47:34 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837254, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:34.327448 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.317882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:49401 (local address 127.12.145.126:36035)
0619 02:47:34.317946 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.317948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.318175 (+ 227us) server_negotiation.cc:407] Connection header received
0619 02:47:34.318739 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.318740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.318751 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.318816 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:34.319739 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.320257 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.321654 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.321861 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.321918 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.324348 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:34.324350 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:34.324350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:34.324358 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:34.325832 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.326363 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.326365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.326365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.326419 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.326752 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.326753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.326753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.326870 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:34.326922 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.327257 (+ 335us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.327382 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:47:34.327673 28581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.317865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:49401)
0619 02:47:34.318030 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.318074 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.318627 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.318887 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.318890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.319441 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:34.319633 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.319637 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.320350 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.320351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.321570 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.321573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.321945 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.321946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.322100 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.322741 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:34.322752 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:34.324259 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:34.325924 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:34.325932 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:34.325934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:34.326270 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:34.326493 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:34.326494 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:34.326494 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:34.326673 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:34.326938 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:34.326944 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:34.327111 (+ 167us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.327225 (+ 114us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.327424 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260619 02:47:34.328133 28579 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36035
I20260619 02:47:34.328243 28579 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:34.328423 28579 heartbeater.cc:511] Master 127.12.145.126:36035 requested a full tablet report, sending...
I20260619 02:47:34.328790 28254 ts_manager.cc:194] Registered new tserver with Master: 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895)
I20260619 02:47:34.329169 28254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:49401
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:47:34.348819 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36035
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:34.429474 28584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:34.429667 28584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:34.429690 28584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:34.430850 28584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:34.430891 28584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:34.430917 28584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:47:34.432341 28584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:34.432585 28584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:34.432823 28584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:34.437790 28592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:34.437829 28590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:34.438036 28584 server_base.cc:1034] running on GCE node
W20260619 02:47:34.437796 28589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:34.438396 28584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:34.438705 28584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:34.439901 28584 hybrid_clock.cc:648] HybridClock initialized: now 1781837254439884 us; error 26 us; skew 500 ppm
Jun 19 02:47:34 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837254, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:34.442888 28584 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:47:34.443383 28584 webserver.cc:460] Webserver started at http://127.12.145.67:42321/ using document root <none> and password file <none>
I20260619 02:47:34.443686 28584 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:34.443733 28584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:34.443881 28584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:47:34.444995 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "71f2560064c235614356e74a0123f479"
server_key_iv: "cc9370a76d972e248a116bb825fd1075"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.445338 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "71f2560064c235614356e74a0123f479"
server_key_iv: "cc9370a76d972e248a116bb825fd1075"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.446656 28584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:47:34.447465 28599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.447681 28584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:34.447767 28584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "71f2560064c235614356e74a0123f479"
server_key_iv: "cc9370a76d972e248a116bb825fd1075"
server_key_version: "encryptionkey@0"
I20260619 02:47:34.447836 28584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:34.466385 28584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:34.468878 28584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:34.469045 28584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:34.469273 28584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:34.469638 28584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:34.469693 28584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.469736 28584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:34.469764 28584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:34.476189 28584 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:39347
I20260619 02:47:34.476228 28712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:39347 every 8 connection(s)
I20260619 02:47:34.476577 28584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:47:34 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837254, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:34.483719 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28584
I20260619 02:47:34.483844 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:47:34.484043 12869 external_mini_cluster.cc:1428] Setting key 5bd87c2a4ee81f4b697ccd602b09de53
I20260619 02:47:34.485939 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.477309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:35907 (local address 127.12.145.126:36035)
0619 02:47:34.477378 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.477380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.477576 (+ 196us) server_negotiation.cc:407] Connection header received
0619 02:47:34.478049 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.478050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.478061 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.478128 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:34.479083 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.479584 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.480587 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.480776 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.480849 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.482987 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:34.482988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:34.482989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:34.482995 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:34.484579 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.485104 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.485105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.485106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.485168 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.485394 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.485394 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.485394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.485504 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:34.485556 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.485761 (+ 205us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.485852 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260619 02:47:34.486091 28715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.477299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:35907)
0619 02:47:34.477446 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.477488 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.477966 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.478182 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.478185 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.478804 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:34.478999 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.479004 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.479687 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.479688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.480490 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.480492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.480855 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.480856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.480963 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.481505 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:34.481514 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:34.482902 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:34.484658 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:34.484665 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:34.484667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:34.485001 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:34.485241 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:34.485241 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:34.485241 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:34.485338 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:34.485548 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:34.485551 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:34.485657 (+ 106us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.485733 (+ 76us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.485872 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260619 02:47:34.486588 28713 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36035
I20260619 02:47:34.486696 28713 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:34.486873 28713 heartbeater.cc:511] Master 127.12.145.126:36035 requested a full tablet report, sending...
I20260619 02:47:34.487246 28254 ts_manager.cc:194] Registered new tserver with Master: b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347)
I20260619 02:47:34.487620 28254 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:35907
I20260619 02:47:34.495823 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:47:34.503173 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.497097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52256 (local address 127.12.145.126:36035)
0619 02:47:34.497255 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.497257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.497367 (+ 110us) server_negotiation.cc:407] Connection header received
0619 02:47:34.497459 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.497460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.497477 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.497538 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:34.498123 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.498658 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.499401 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.499597 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.499669 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.500866 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:34.500867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:34.500867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:34.500874 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:34.502017 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.502360 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.502361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.502361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.502419 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:34.502630 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:34.502630 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:34.502631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:34.502779 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:34.502892 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.502995 (+ 103us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.503074 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:47:34.504611 28254 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:47:34.506189 28254 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:47:34.512701 28728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.508693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34895 (local address 127.0.0.1:47960)
0619 02:47:34.508907 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.508917 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.508986 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.509317 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.509317 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.509318 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:34.509345 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.509346 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.510639 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.510640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.511716 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.511717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.512399 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.512400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.512479 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.512494 (+ 15us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.512567 (+ 73us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.512620 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":2,"thread_start_us":62,"threads_started":1}
I20260619 02:47:34.512712 28729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.508803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47960 (local address 127.12.145.66:34895)
0619 02:47:34.509144 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.509148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.509158 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:47:34.509196 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.509198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.509215 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.509320 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:34.509402 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.510512 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.511804 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.512299 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.512396 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.512468 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.512583 (+ 115us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.512623 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":75,"threads_started":1}
I20260619 02:47:34.512848 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.508480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:39347 (local address 127.0.0.1:37958)
0619 02:47:34.508884 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.508893 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.508990 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.509251 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.509252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.509254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:34.509329 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.509332 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.510670 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.510671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.511565 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.511567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.512553 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.512554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.512629 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.512632 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.512680 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.512739 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":8,"thread_start_us":87,"threads_started":1}
I20260619 02:47:34.513128 28726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.508597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34294 (local address 127.12.145.65:33279)
0619 02:47:34.508839 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.508844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.508989 (+ 145us) server_negotiation.cc:407] Connection header received
0619 02:47:34.509054 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.509056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.509072 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.509145 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:34.509510 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.510195 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.511691 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.512388 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.512460 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.512515 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.513003 (+ 488us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.513050 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
I20260619 02:47:34.513142 28727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.508652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37958 (local address 127.12.145.67:39347)
0619 02:47:34.508843 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.508848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.508960 (+ 112us) server_negotiation.cc:407] Connection header received
0619 02:47:34.509086 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.509089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.509106 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.509155 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:34.509396 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.510518 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.511651 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.512388 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.512468 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.512515 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.513024 (+ 509us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.513065 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260619 02:47:34.513310 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.508471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33279 (local address 127.0.0.1:34294)
0619 02:47:34.508782 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.508829 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.508907 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.509237 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.509240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.509243 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:34.509420 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.509421 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.510296 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.510297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.511605 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.511608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.512552 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.512553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.512627 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.512630 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.512680 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.512739 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":145,"thread_start_us":77,"threads_started":1}
I20260619 02:47:34.513506 28513 tablet_service.cc:1467] Processing CreateTablet for tablet 0df7c23277eb42019b5e94e1cc0f431d (DEFAULT_TABLE table=test-table [id=9824ee667690464aaaad787b1056c822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:34.513886 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df7c23277eb42019b5e94e1cc0f431d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:34.513820 28647 tablet_service.cc:1467] Processing CreateTablet for tablet 0df7c23277eb42019b5e94e1cc0f431d (DEFAULT_TABLE table=test-table [id=9824ee667690464aaaad787b1056c822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:34.514132 28647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df7c23277eb42019b5e94e1cc0f431d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:34.516855 28730 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Bootstrap starting.
I20260619 02:47:34.516860 28379 tablet_service.cc:1467] Processing CreateTablet for tablet 0df7c23277eb42019b5e94e1cc0f431d (DEFAULT_TABLE table=test-table [id=9824ee667690464aaaad787b1056c822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:34.517161 28379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df7c23277eb42019b5e94e1cc0f431d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:34.517494 28730 tablet_bootstrap.cc:654] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:34.517968 28730 log.cc:824] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:34.518311 28731 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Bootstrap starting.
I20260619 02:47:34.518783 28730 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: No bootstrap required, opened a new log
I20260619 02:47:34.518851 28730 ts_tablet_manager.cc:1397] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:47:34.519006 28731 tablet_bootstrap.cc:654] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:34.519526 28731 log.cc:824] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:34.519869 28733 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap starting.
I20260619 02:47:34.520485 28733 tablet_bootstrap.cc:654] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:34.520995 28733 log.cc:824] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:34.521335 28730 raft_consensus.cc:348] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.521518 28730 raft_consensus.cc:374] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:34.521564 28730 raft_consensus.cc:729] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9be4cae3bf24d8fb830bd3f6c1fcc31, State: Initialized, Role: FOLLOWER
I20260619 02:47:34.521677 28730 consensus_queue.cc:260] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.521709 28733 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: No bootstrap required, opened a new log
I20260619 02:47:34.521713 28731 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: No bootstrap required, opened a new log
I20260619 02:47:34.521798 28733 ts_tablet_manager.cc:1397] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:47:34.521798 28731 ts_tablet_manager.cc:1397] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260619 02:47:34.521983 28730 ts_tablet_manager.cc:1428] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:47:34.522018 28713 heartbeater.cc:503] Master 127.12.145.126:36035 was elected leader, sending a full tablet report...
I20260619 02:47:34.523730 28733 raft_consensus.cc:348] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.523730 28731 raft_consensus.cc:348] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.523916 28731 raft_consensus.cc:374] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:34.523916 28733 raft_consensus.cc:374] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:34.523957 28731 raft_consensus.cc:729] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da83e06ae2b461d930b30cf00dc6dac, State: Initialized, Role: FOLLOWER
I20260619 02:47:34.523993 28733 raft_consensus.cc:729] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475414214c3c47fe8009cf9e7cf263ac, State: Initialized, Role: FOLLOWER
I20260619 02:47:34.524068 28731 consensus_queue.cc:260] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.524089 28733 consensus_queue.cc:260] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.524335 28731 ts_tablet_manager.cc:1428] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260619 02:47:34.524335 28733 ts_tablet_manager.cc:1428] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:47:34.524397 28579 heartbeater.cc:503] Master 127.12.145.126:36035 was elected leader, sending a full tablet report...
I20260619 02:47:34.524454 28445 heartbeater.cc:503] Master 127.12.145.126:36035 was elected leader, sending a full tablet report...
W20260619 02:47:34.567801 28580 tablet.cc:2369] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:47:34.655476 28446 tablet.cc:2369] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:34.725507 28736 raft_consensus.cc:482] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:34.725628 28736 raft_consensus.cc:504] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.726068 28736 leader_election.cc:288] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279), 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895)
W20260619 02:47:34.727100 28714 tablet.cc:2369] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:34.729166 28729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.726605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:57757 (local address 127.12.145.66:34895)
0619 02:47:34.726676 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.726678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.726688 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:47:34.726716 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.726717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.726724 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.726797 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:34.726970 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.727493 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.728422 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.728810 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.728904 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.728920 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.729064 (+ 144us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.729098 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260619 02:47:34.729182 28739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.726402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34895 (local address 127.12.145.67:57757)
0619 02:47:34.726569 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.726578 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.726614 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.726805 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.726806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.726807 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:34.726880 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.726885 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.727575 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.727576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.728331 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.728333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.728904 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.728905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.728977 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.728981 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.729057 (+ 76us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.729098 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":2,"thread_start_us":94,"threads_started":1}
I20260619 02:47:34.729235 28726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.726364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:36905 (local address 127.12.145.65:33279)
0619 02:47:34.726418 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.726420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.726438 (+ 18us) server_negotiation.cc:407] Connection header received
0619 02:47:34.726537 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.726538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.726569 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.726647 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:34.726827 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.727479 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.728424 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.728870 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.728955 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.728963 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.729127 (+ 164us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.729163 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260619 02:47:34.729441 28715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.726285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33279 (local address 127.12.145.67:36905)
0619 02:47:34.726333 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.726345 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:34.726429 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:34.726672 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:34.726673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:34.726676 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:34.726752 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.726753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.727568 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.727569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.728318 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:34.728320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.728952 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.728953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:34.729037 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.729042 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:47:34.729117 (+ 75us) client_negotiation.cc:240] Negotiation successful
0619 02:47:34.729155 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":21}
I20260619 02:47:34.729580 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df7c23277eb42019b5e94e1cc0f431d" candidate_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da83e06ae2b461d930b30cf00dc6dac" is_pre_election: true
I20260619 02:47:34.729744 28533 raft_consensus.cc:2454] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9be4cae3bf24d8fb830bd3f6c1fcc31 in term 0.
I20260619 02:47:34.729756 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df7c23277eb42019b5e94e1cc0f431d" candidate_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475414214c3c47fe8009cf9e7cf263ac" is_pre_election: true
I20260619 02:47:34.729885 28399 raft_consensus.cc:2454] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9be4cae3bf24d8fb830bd3f6c1fcc31 in term 0.
I20260619 02:47:34.729966 28600 leader_election.cc:302] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31; no voters:
I20260619 02:47:34.730088 28736 raft_consensus.cc:2781] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:47:34.730144 28736 raft_consensus.cc:482] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:47:34.730173 28736 raft_consensus.cc:3037] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:34.730933 28736 raft_consensus.cc:504] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.731062 28736 leader_election.cc:288] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [CANDIDATE]: Term 1 election: Requested vote from peers 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279), 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895)
I20260619 02:47:34.731208 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df7c23277eb42019b5e94e1cc0f431d" candidate_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475414214c3c47fe8009cf9e7cf263ac"
I20260619 02:47:34.731240 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df7c23277eb42019b5e94e1cc0f431d" candidate_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da83e06ae2b461d930b30cf00dc6dac"
I20260619 02:47:34.731305 28533 raft_consensus.cc:3037] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:34.731298 28399 raft_consensus.cc:3037] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:34.732183 28399 raft_consensus.cc:2454] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9be4cae3bf24d8fb830bd3f6c1fcc31 in term 1.
I20260619 02:47:34.732183 28533 raft_consensus.cc:2454] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9be4cae3bf24d8fb830bd3f6c1fcc31 in term 1.
I20260619 02:47:34.732383 28600 leader_election.cc:302] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31; no voters:
I20260619 02:47:34.732496 28736 raft_consensus.cc:2781] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:34.732659 28736 raft_consensus.cc:686] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 LEADER]: Becoming Leader. State: Replica: b9be4cae3bf24d8fb830bd3f6c1fcc31, State: Running, Role: LEADER
I20260619 02:47:34.732762 28736 consensus_queue.cc:237] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:34.733579 28253 catalog_manager.cc:5495] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67). New cstate: current_term: 1 leader_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260619 02:47:34.795027 28727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.792482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37968 (local address 127.12.145.67:39347)
0619 02:47:34.792540 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:34.792543 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:34.792559 (+ 16us) server_negotiation.cc:407] Connection header received
0619 02:47:34.792644 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:34.792645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:34.792662 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:34.792743 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:47:34.792907 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.793418 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.794207 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:34.794410 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:34.794499 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:34.794697 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:47:34.794803 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:47:34.794901 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:34.794920 (+ 19us) server_negotiation.cc:299] Negotiation successful
0619 02:47:34.794940 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:47:34.796880 28533 raft_consensus.cc:1261] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 1 FOLLOWER]: Refusing update from remote peer b9be4cae3bf24d8fb830bd3f6c1fcc31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:34.796927 28399 raft_consensus.cc:1261] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Refusing update from remote peer b9be4cae3bf24d8fb830bd3f6c1fcc31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:34.797268 28740 consensus_queue.cc:1035] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:34.797417 28736 consensus_queue.cc:1035] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:34.799724 28745 mvcc.cc:205] Tried to move back new op lower bound from 7298405395644891136 to 7298405395385888768. Current Snapshot: MvccSnapshot[applied={T|T < 7298405395644891136}]
I20260619 02:47:34.800592 28744 mvcc.cc:205] Tried to move back new op lower bound from 7298405395644891136 to 7298405395385888768. Current Snapshot: MvccSnapshot[applied={T|T < 7298405395644891136}]
I20260619 02:47:34.801976 28253 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:34.802057 28253 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:34.802876 28253 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Sending DeleteTablet for 3 replicas of tablet 0df7c23277eb42019b5e94e1cc0f431d
I20260619 02:47:34.803277 28647 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df7c23277eb42019b5e94e1cc0f431d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:34 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:37958
I20260619 02:47:34.803282 28513 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df7c23277eb42019b5e94e1cc0f431d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:34 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:47960
I20260619 02:47:34.803239 28379 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df7c23277eb42019b5e94e1cc0f431d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:34 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:34294
I20260619 02:47:34.803486 28754 tablet_replica.cc:330] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: stopping tablet replica
I20260619 02:47:34.803498 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28316
I20260619 02:47:34.804325 28755 tablet_replica.cc:330] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: stopping tablet replica
I20260619 02:47:34.804493 28755 raft_consensus.cc:2229] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:34.804654 28755 raft_consensus.cc:2258] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:34.805168 28755 ts_tablet_manager.cc:1905] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:34.806949 28755 ts_tablet_manager.cc:1918] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:34.807075 28755 log.cc:1196] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/0df7c23277eb42019b5e94e1cc0f431d
I20260619 02:47:34.807418 28755 ts_tablet_manager.cc:1939] T 0df7c23277eb42019b5e94e1cc0f431d P 9da83e06ae2b461d930b30cf00dc6dac: Deleting consensus metadata
I20260619 02:47:34.807858 28753 tablet_replica.cc:330] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: stopping tablet replica
I20260619 02:47:34.807915 28238 catalog_manager.cc:4841] TS 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895): tablet 0df7c23277eb42019b5e94e1cc0f431d (table test-table [id=9824ee667690464aaaad787b1056c822]) successfully deleted
I20260619 02:47:34.808053 28753 raft_consensus.cc:2229] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:47:34.808214 28753 raft_consensus.cc:2258] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:34.808651 28753 ts_tablet_manager.cc:1905] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 02:47:34.808858 28238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:33279 (error 108)
I20260619 02:47:34.809135 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28450
I20260619 02:47:34.811030 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.810918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33279 (local address 127.0.0.1:34300)
0619 02:47:34.810964 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.810995 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:33279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260619 02:47:34.811137 28238 catalog_manager.cc:4584] TS 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0df7c23277eb42019b5e94e1cc0f431d: Network error: Client connection negotiation failed: client connection to 127.12.145.65:33279: connect: Connection refused (error 111)
I20260619 02:47:34.814854 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28584
I20260619 02:47:34.819017 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28222
I20260619 02:47:34.819049 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:34.818919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:39347 (local address 127.0.0.1:37970)
0619 02:47:34.818977 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:34.819009 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.67:39347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260619 02:47:54.824337 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36035
--webserver_interface=127.12.145.126
--webserver_port=33145
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:36035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:47:54.910476 28757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:54.910689 28757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:54.910710 28757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:54.911872 28757 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 02:47:54.911912 28757 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 02:47:54.911926 28757 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 02:47:54.911974 28757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:47:54.912002 28757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:54.912030 28757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:54.912051 28757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:47:54.912079 28757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:47:54.913559 28757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:36035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=33145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:54.913808 28757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:54.914052 28757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 02:47:54.922935 28757 server_base.cc:1034] running on GCE node
W20260619 02:47:54.922921 28763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:54.922921 28764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:54.922921 28766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:54.923540 28757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:54.923879 28757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:54.925031 28757 hybrid_clock.cc:648] HybridClock initialized: now 1781837274925017 us; error 30 us; skew 500 ppm
Jun 19 02:47:54 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837274, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:54.928148 28757 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:47:54.928633 28757 webserver.cc:460] Webserver started at http://127.12.145.126:33145/ using document root <none> and password file <none>
I20260619 02:47:54.928887 28757 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:54.928941 28757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:54.930331 28757 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:54.931064 28773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:54.931243 28757 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:54.931335 28757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "4e6c45007da8447ab29389d31fb24211"
format_stamp: "Formatted at 2026-06-19 02:47:33 on dist-test-slave-fbl4"
server_key: "f4e92b3eba28a35ff539acff23d71e29"
server_key_iv: "cedf38294f58807253dcff23a5fe1d08"
server_key_version: "encryptionkey@0"
I20260619 02:47:54.931737 28757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:54.949247 28757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:54.951529 28757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:54.951682 28757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:54.955786 28757 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:36035
I20260619 02:47:54.955835 28825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:36035 every 8 connection(s)
I20260619 02:47:54.956230 28757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:47:54.957621 28826 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:47:54.958261 28826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Bootstrap starting.
I20260619 02:47:54.959673 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28757
I20260619 02:47:54.959976 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:33279
--local_ip_for_outbound_sockets=127.12.145.65
--tserver_master_addrs=127.12.145.126:36035
--webserver_port=46573
--webserver_interface=127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:54.966372 28826 log.cc:824] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:54.968175 28826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:47:54.968480 28826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Bootstrap complete.
I20260619 02:47:54.970726 28826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:54.970975 28826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e6c45007da8447ab29389d31fb24211, State: Initialized, Role: FOLLOWER
I20260619 02:47:54.971175 28826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:54.971269 28826 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:47:54.971329 28826 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:47:54.971390 28826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 1 FOLLOWER]: Advancing to term 2
I20260619 02:47:54.972394 28826 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:54.972513 28826 leader_election.cc:302] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e6c45007da8447ab29389d31fb24211; no voters:
I20260619 02:47:54.972687 28826 leader_election.cc:288] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 02:47:54.972747 28830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 02:47:54.972888 28830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 LEADER]: Becoming Leader. State: Replica: 4e6c45007da8447ab29389d31fb24211, State: Running, Role: LEADER
I20260619 02:47:54.972949 28826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:47:54.973030 28830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:47:54.973412 28832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e6c45007da8447ab29389d31fb24211. Latest consensus state: current_term: 2 leader_uuid: "4e6c45007da8447ab29389d31fb24211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } } }
I20260619 02:47:54.973479 28832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:54.973737 28831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4e6c45007da8447ab29389d31fb24211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } } }
I20260619 02:47:54.973785 28831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: This master's current role is: LEADER
I20260619 02:47:54.974011 28838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:47:54.974825 28838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:47:54.974972 28838 catalog_manager.cc:1259] Loaded cluster ID: c91bf6f6f0164328bed697db7b9098f1
I20260619 02:47:54.975167 28838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:47:54.976328 28838 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:47:54.976492 28838 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Loaded TSK: 0
I20260619 02:47:54.994285 28838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Generated new TSK 1
I20260619 02:47:54.994385 28838 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 02:47:55.042354 28828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:55.042601 28828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:55.042651 28828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:55.043798 28828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:55.043864 28828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:55.043910 28828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:47:55.045367 28828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:33279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=46573
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:55.045621 28828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:55.045852 28828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:55.051262 28854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:55.051324 28855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:55.051421 28828 server_base.cc:1034] running on GCE node
W20260619 02:47:55.051527 28857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:55.051769 28828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:55.052062 28828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:55.053241 28828 hybrid_clock.cc:648] HybridClock initialized: now 1781837275053226 us; error 27 us; skew 500 ppm
Jun 19 02:47:55 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:55.056324 28828 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:47:55.056804 28828 webserver.cc:460] Webserver started at http://127.12.145.65:46573/ using document root <none> and password file <none>
I20260619 02:47:55.057030 28828 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:55.057086 28828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:55.058455 28828 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:55.059185 28864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:55.059433 28828 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:47:55.059545 28828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "475414214c3c47fe8009cf9e7cf263ac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "9f2b99aaa0a431910fd8ea4c6959a43d"
server_key_iv: "295d0ab1d90748d574109b7ec4335488"
server_key_version: "encryptionkey@0"
I20260619 02:47:55.059897 28828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:55.083171 28828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:55.085456 28828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:55.085615 28828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:55.085875 28828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:55.086313 28871 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260619 02:47:55.088223 28828 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 02:47:55.088315 28828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260619 02:47:55.088356 28828 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 02:47:55.088965 28828 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 02:47:55.089025 28828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:55.089090 28871 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap starting.
I20260619 02:47:55.096004 28828 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:33279
I20260619 02:47:55.096376 28828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:47:55.096844 28978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:33279 every 8 connection(s)
I20260619 02:47:55.099608 28871 log.cc:824] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:55.102070 28871 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:47:55.102432 28871 tablet_bootstrap.cc:492] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap complete.
Jun 19 02:47:55 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:55.103672 28871 ts_tablet_manager.cc:1397] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.009s
I20260619 02:47:55.104914 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28828
I20260619 02:47:55.104959 28871 raft_consensus.cc:348] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:55.105300 28871 raft_consensus.cc:729] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475414214c3c47fe8009cf9e7cf263ac, State: Initialized, Role: FOLLOWER
I20260619 02:47:55.105454 28871 consensus_queue.cc:260] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } } peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } }
I20260619 02:47:55.105660 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:34895
--local_ip_for_outbound_sockets=127.12.145.66
--tserver_master_addrs=127.12.145.126:36035
--webserver_port=45867
--webserver_interface=127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:55.105747 28871 ts_tablet_manager.cc:1428] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260619 02:47:55.108264 28981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.097137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:37791)
0619 02:47:55.097402 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.097442 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.097870 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.098382 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.098387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.098722 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:55.098907 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.098911 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.100244 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.100246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.101142 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.101144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.101778 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.101779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.101924 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.102498 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:55.102509 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:55.104022 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:55.106494 (+ 2472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:55.106501 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:55.106503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:55.106845 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:55.107149 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:55.107150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:55.107150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:55.107286 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:55.107649 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:55.107655 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:55.107788 (+ 133us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.107889 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.108060 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":103,"threads_started":1}
I20260619 02:47:55.108264 28982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.097221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:37791 (local address 127.12.145.126:36035)
0619 02:47:55.098019 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.098026 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.098050 (+ 24us) server_negotiation.cc:407] Connection header received
0619 02:47:55.098146 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.098150 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.098199 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.098331 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:55.099023 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.100103 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.101238 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.101654 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.101786 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.104132 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:55.104136 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:55.104136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:55.104148 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:55.106367 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.106943 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.106946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.106947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.107064 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.107359 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.107359 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.107360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.107562 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:55.107655 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.107962 (+ 307us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.108087 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":757,"thread_start_us":81,"threads_started":1}
I20260619 02:47:55.109004 28979 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36035
I20260619 02:47:55.109097 28979 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:55.109266 28979 heartbeater.cc:511] Master 127.12.145.126:36035 requested a full tablet report, sending...
I20260619 02:47:55.109989 28790 ts_manager.cc:194] Registered new tserver with Master: 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279)
I20260619 02:47:55.111207 28790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:37791
I20260619 02:47:55.112289 28979 heartbeater.cc:503] Master 127.12.145.126:36035 was elected leader, sending a full tablet report...
I20260619 02:47:55.116179 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.110690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33279 (local address 127.0.0.1:43674)
0619 02:47:55.111679 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.111711 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.111825 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.112264 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.112267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.112269 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:55.112325 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.112327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.113714 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.113715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.114885 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.114888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.115895 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.115896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.115973 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.115986 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.116060 (+ 74us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.116108 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"thread_start_us":76,"threads_started":1}
I20260619 02:47:55.116225 28987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.111477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43674 (local address 127.12.145.65:33279)
0619 02:47:55.111618 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.111623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.111779 (+ 156us) server_negotiation.cc:407] Connection header received
0619 02:47:55.111926 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.111928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.112139 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.112206 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:55.112399 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.113591 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.114977 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.115798 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.115882 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.115943 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.116091 (+ 148us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.116138 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":73,"threads_started":1}
I20260619 02:47:55.116912 28913 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df7c23277eb42019b5e94e1cc0f431d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:34 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:43674
I20260619 02:47:55.117509 28988 tablet_replica.cc:330] stopping tablet replica
I20260619 02:47:55.117614 28988 raft_consensus.cc:2229] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:55.117677 28988 raft_consensus.cc:2258] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:55.117938 28988 ts_tablet_manager.cc:1905] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:55.120165 28988 ts_tablet_manager.cc:1918] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:55.120224 28988 log.cc:1196] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal/wals/0df7c23277eb42019b5e94e1cc0f431d
I20260619 02:47:55.120452 28988 ts_tablet_manager.cc:1939] T 0df7c23277eb42019b5e94e1cc0f431d P 475414214c3c47fe8009cf9e7cf263ac: Deleting consensus metadata
I20260619 02:47:55.120893 28774 catalog_manager.cc:4841] TS 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279): tablet 0df7c23277eb42019b5e94e1cc0f431d (table test-table [id=9824ee667690464aaaad787b1056c822]) successfully deleted
W20260619 02:47:55.189601 28985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:55.189813 28985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:55.189849 28985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:55.191037 28985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:55.191102 28985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:55.191145 28985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:47:55.192576 28985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:34895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=45867
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:55.192828 28985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:55.193055 28985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:55.197902 28993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:55.197892 28994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:55.197892 28996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:55.198577 28985 server_base.cc:1034] running on GCE node
I20260619 02:47:55.198791 28985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:55.199018 28985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:55.200171 28985 hybrid_clock.cc:648] HybridClock initialized: now 1781837275200147 us; error 36 us; skew 500 ppm
Jun 19 02:47:55 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:55.202440 28985 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:47:55.202857 28985 webserver.cc:460] Webserver started at http://127.12.145.66:45867/ using document root <none> and password file <none>
I20260619 02:47:55.203075 28985 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:55.203155 28985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:55.204430 28985 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:47:55.204968 29003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:55.205120 28985 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:47:55.205220 28985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "9da83e06ae2b461d930b30cf00dc6dac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "cec90ddd92c49f1d0f02b2b86b3ccf38"
server_key_iv: "bbbc9282033c8dbd23b924f14bd82cec"
server_key_version: "encryptionkey@0"
I20260619 02:47:55.205542 28985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:55.242883 28985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:55.244719 28985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:55.244879 28985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:55.245112 28985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:55.245416 28985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:47:55.245468 28985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:55.245509 28985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:55.245536 28985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:55.251417 28985 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34895
I20260619 02:47:55.251452 29116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34895 every 8 connection(s)
I20260619 02:47:55.251796 28985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:47:55 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:55.260560 28982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.252495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:50973 (local address 127.12.145.126:36035)
0619 02:47:55.252547 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.252549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.252738 (+ 189us) server_negotiation.cc:407] Connection header received
0619 02:47:55.253240 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.253242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.253253 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.253311 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:55.254239 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.254798 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.255755 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.255956 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.256007 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.257962 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:55.257963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:55.257963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:55.257970 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:55.259429 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.259806 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.259807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.259807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.259857 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.260064 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.260064 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.260064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.260160 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:55.260208 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.260431 (+ 223us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.260497 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:47:55.260694 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.252465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:50973)
0619 02:47:55.252621 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.252662 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.253138 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.253387 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.253390 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.253950 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:55.254128 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.254133 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.254898 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.254899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.255679 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.255681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.256028 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.256029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.256123 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.256549 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:55.256557 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:55.257879 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:55.259506 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:55.259512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:55.259513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:55.259729 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:55.259916 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:55.259917 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:55.259917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:55.260010 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:55.260212 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:55.260216 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:55.260326 (+ 110us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.260405 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.260515 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260619 02:47:55.261184 29117 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36035
I20260619 02:47:55.261278 29117 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:55.261480 29117 heartbeater.cc:511] Master 127.12.145.126:36035 requested a full tablet report, sending...
I20260619 02:47:55.261870 28790 ts_manager.cc:194] Registered new tserver with Master: 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895)
I20260619 02:47:55.261966 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 28985
I20260619 02:47:55.262300 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:39347
--local_ip_for_outbound_sockets=127.12.145.67
--tserver_master_addrs=127.12.145.126:36035
--webserver_port=42321
--webserver_interface=127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:47:55.262341 28790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:50973
W20260619 02:47:55.340665 29120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:47:55.340847 29120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:47:55.340868 29120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:47:55.341957 29120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:47:55.341995 29120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:47:55.342020 29120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:47:55.343386 29120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:39347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=42321
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:47:55.343608 29120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:47:55.343825 29120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:47:55.348472 29128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:55.348510 29126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:47:55.348483 29125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:47:55.348510 29120 server_base.cc:1034] running on GCE node
I20260619 02:47:55.348814 29120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:47:55.349057 29120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:47:55.350219 29120 hybrid_clock.cc:648] HybridClock initialized: now 1781837275350212 us; error 38 us; skew 500 ppm
Jun 19 02:47:55 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:47:55.352617 29120 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:47:55.353029 29120 webserver.cc:460] Webserver started at http://127.12.145.67:42321/ using document root <none> and password file <none>
I20260619 02:47:55.353268 29120 fs_manager.cc:359] Metadata directory not provided
I20260619 02:47:55.353353 29120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:47:55.354665 29120 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:47:55.355301 29135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:55.355461 29120 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:47:55.355556 29120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "71f2560064c235614356e74a0123f479"
server_key_iv: "cc9370a76d972e248a116bb825fd1075"
server_key_version: "encryptionkey@0"
I20260619 02:47:55.355876 29120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:47:55.376360 29120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:47:55.378643 29120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:47:55.378793 29120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:47:55.378993 29120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:47:55.379422 29142 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260619 02:47:55.380684 29142 ts_tablet_manager.cc:1852] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260619 02:47:55.380910 29142 ts_tablet_manager.cc:1905] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:55.383018 29142 ts_tablet_manager.cc:1918] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:55.383096 29142 log.cc:1196] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/0df7c23277eb42019b5e94e1cc0f431d
I20260619 02:47:55.383419 29142 ts_tablet_manager.cc:1939] T 0df7c23277eb42019b5e94e1cc0f431d P b9be4cae3bf24d8fb830bd3f6c1fcc31: Deleting consensus metadata
I20260619 02:47:55.383670 29120 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260619 02:47:55.383744 29120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260619 02:47:55.383811 29120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:47:55.383834 29120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:55.389341 29120 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:39347
I20260619 02:47:55.389430 29249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:39347 every 8 connection(s)
I20260619 02:47:55.389695 29120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:47:55 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837275, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:47:55.397186 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 29120
I20260619 02:47:55.398012 28982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.390447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:36491 (local address 127.12.145.126:36035)
0619 02:47:55.390523 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.390525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.390745 (+ 220us) server_negotiation.cc:407] Connection header received
0619 02:47:55.391124 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.391125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.391134 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.391188 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:55.391687 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.392148 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.393061 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.393260 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.393309 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.395385 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:55.395387 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:55.395387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:55.395393 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:55.396581 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.396910 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.396911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.396911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.396959 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.397275 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.397276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.397276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.397390 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:55.397475 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.397812 (+ 337us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.397917 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:47:55.398247 29252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.390416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:36491)
0619 02:47:55.390628 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.390665 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.391052 (+ 387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.391233 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.391236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.391458 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:47:55.391621 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.391624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.392255 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.392255 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.392993 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.392995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.393329 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.393330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.393423 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.393924 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:47:55.393950 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:47:55.395308 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:47:55.396645 (+ 1337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:55.396650 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:55.396652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:55.396847 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:55.397020 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:47:55.397021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:47:55.397021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:47:55.397156 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:47:55.397465 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:47:55.397470 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:47:55.397610 (+ 140us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.397767 (+ 157us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.397981 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":117,"threads_started":1}
I20260619 02:47:55.398922 29250 heartbeater.cc:347] Connected to a master server at 127.12.145.126:36035
I20260619 02:47:55.399005 29250 heartbeater.cc:464] Registering TS with master...
I20260619 02:47:55.399183 29250 heartbeater.cc:511] Master 127.12.145.126:36035 requested a full tablet report, sending...
I20260619 02:47:55.399542 28790 ts_manager.cc:194] Registered new tserver with Master: b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347)
I20260619 02:47:55.400002 28790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:36491
I20260619 02:47:55.404179 29254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.397623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42886 (local address 127.12.145.126:36035)
0619 02:47:55.397743 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.397745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.397850 (+ 105us) server_negotiation.cc:407] Connection header received
0619 02:47:55.397940 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.397941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.397953 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.398018 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:55.398761 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.399391 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.400428 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.400710 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.400785 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.401814 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:55.401815 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:55.401815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:55.401821 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:55.403033 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.403590 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.403590 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.403591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.403642 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.403811 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.403812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.403812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.403899 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:55.404016 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.404063 (+ 47us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.404119 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
I20260619 02:47:55.404892 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:47:55.407289 29254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.405254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42896 (local address 127.12.145.126:36035)
0619 02:47:55.405308 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.405310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.405351 (+ 41us) server_negotiation.cc:407] Connection header received
0619 02:47:55.405413 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.405413 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.405438 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.405490 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:47:55.405560 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.405973 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.406686 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.406870 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.406921 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.407051 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:47:55.407099 (+ 48us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0619 02:47:55.407251 (+ 152us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42896: token expired
Metrics: {"server-negotiator.queue_time_us":37}
W20260619 02:47:55.407326 29254 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42896: token expired
W20260619 02:47:55.407402 28717 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.145.126:36035)
I20260619 02:47:55.412640 29254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.407631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42906 (local address 127.12.145.126:36035)
0619 02:47:55.407661 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.407663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.407671 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:47:55.407720 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.407720 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.407726 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.407770 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:47:55.408240 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.408658 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.409352 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.409524 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.409570 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.410706 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:47:55.410707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:47:55.410707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:47:55.410713 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:47:55.411834 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.412118 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.412119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.412119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.412165 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:47:55.412275 (+ 110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:47:55.412276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:47:55.412276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:47:55.412378 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:47:55.412450 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.412538 (+ 88us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.412592 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260619 02:47:55.413585 28790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:47:55.415303 28790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:47:55.417299 28913 tablet_service.cc:1467] Processing CreateTablet for tablet c423678bd4a94599ab29548be5460e41 (DEFAULT_TABLE table=test-table [id=18b4b0d14f89430ab0f2523ea7cfeef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:55.417528 28913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c423678bd4a94599ab29548be5460e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:55.418948 28871 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap starting.
I20260619 02:47:55.419291 28871 tablet_bootstrap.cc:654] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:55.419770 28871 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: No bootstrap required, opened a new log
I20260619 02:47:55.419826 28871 ts_tablet_manager.cc:1397] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260619 02:47:55.419922 28871 raft_consensus.cc:348] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.419993 28871 raft_consensus.cc:374] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:55.420043 28871 raft_consensus.cc:729] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475414214c3c47fe8009cf9e7cf263ac, State: Initialized, Role: FOLLOWER
I20260619 02:47:55.420095 28871 consensus_queue.cc:260] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.420186 28871 ts_tablet_manager.cc:1428] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260619 02:47:55.421008 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.416984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34895 (local address 127.0.0.1:48308)
0619 02:47:55.417081 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.417092 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.417137 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.417504 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.417504 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.417506 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:55.417543 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.417545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.418579 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.418580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.419754 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.419756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.420775 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.420776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.420841 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.420844 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.420899 (+ 55us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.420938 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":31}
I20260619 02:47:55.421060 29257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.417155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48308 (local address 127.12.145.66:34895)
0619 02:47:55.417311 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.417315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.417325 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:47:55.417363 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.417365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.417379 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.417612 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:55.417700 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.418468 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.419846 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.420675 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.420771 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.420822 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.420915 (+ 93us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.420955 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260619 02:47:55.421566 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.416996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:39347 (local address 127.0.0.1:50852)
0619 02:47:55.417132 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.417141 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.417181 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.417555 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.417556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.417558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:55.417592 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.417593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.418685 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.418686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.419771 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.419772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.421328 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.421329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.421408 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.421413 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.421472 (+ 59us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.421506 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260619 02:47:55.421566 29258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.417221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50852 (local address 127.12.145.67:39347)
0619 02:47:55.417382 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.417386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.417408 (+ 22us) server_negotiation.cc:407] Connection header received
0619 02:47:55.417456 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.417457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.417471 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.417548 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:55.417646 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.418609 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.420278 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.421265 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.421328 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.421378 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.421483 (+ 105us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.421510 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260619 02:47:55.421790 29051 tablet_service.cc:1467] Processing CreateTablet for tablet c423678bd4a94599ab29548be5460e41 (DEFAULT_TABLE table=test-table [id=18b4b0d14f89430ab0f2523ea7cfeef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:55.422111 29051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c423678bd4a94599ab29548be5460e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:55.422101 29184 tablet_service.cc:1467] Processing CreateTablet for tablet c423678bd4a94599ab29548be5460e41 (DEFAULT_TABLE table=test-table [id=18b4b0d14f89430ab0f2523ea7cfeef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:47:55.422412 29184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c423678bd4a94599ab29548be5460e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:47:55.423944 29142 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Bootstrap starting.
I20260619 02:47:55.424751 29142 tablet_bootstrap.cc:654] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:55.425062 29142 log.cc:824] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:55.425084 29260 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Bootstrap starting.
I20260619 02:47:55.425623 29260 tablet_bootstrap.cc:654] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Neither blocks nor log segments found. Creating new log.
I20260619 02:47:55.425729 29142 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: No bootstrap required, opened a new log
I20260619 02:47:55.425781 29142 ts_tablet_manager.cc:1397] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:47:55.426088 29260 log.cc:824] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Log is configured to *not* fsync() on all Append() calls
I20260619 02:47:55.426832 29260 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: No bootstrap required, opened a new log
I20260619 02:47:55.426883 29260 ts_tablet_manager.cc:1397] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:47:55.427551 29142 raft_consensus.cc:348] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.427702 29142 raft_consensus.cc:374] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:55.427743 29142 raft_consensus.cc:729] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9be4cae3bf24d8fb830bd3f6c1fcc31, State: Initialized, Role: FOLLOWER
I20260619 02:47:55.427860 29142 consensus_queue.cc:260] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.428135 29142 ts_tablet_manager.cc:1428] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:47:55.428191 29250 heartbeater.cc:503] Master 127.12.145.126:36035 was elected leader, sending a full tablet report...
I20260619 02:47:55.428809 29260 raft_consensus.cc:348] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.428965 29260 raft_consensus.cc:374] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:47:55.429011 29260 raft_consensus.cc:729] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da83e06ae2b461d930b30cf00dc6dac, State: Initialized, Role: FOLLOWER
I20260619 02:47:55.429119 29260 consensus_queue.cc:260] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.429374 29260 ts_tablet_manager.cc:1428] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:47:55.429435 29117 heartbeater.cc:503] Master 127.12.145.126:36035 was elected leader, sending a full tablet report...
W20260619 02:47:55.502360 29118 tablet.cc:2369] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:55.579734 29264 raft_consensus.cc:482] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:47:55.579908 29264 raft_consensus.cc:504] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.580292 29264 leader_election.cc:288] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347), 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279)
I20260619 02:47:55.583250 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.580506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:39347 (local address 127.12.145.66:54685)
0619 02:47:55.580561 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.580573 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.580621 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.580813 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.580814 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.580816 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:55.580904 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.580906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.581645 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.581646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.582396 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.582398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.583019 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.583020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.583101 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.583105 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.583158 (+ 53us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.583199 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":1}
I20260619 02:47:55.583316 29258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.580591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:54685 (local address 127.12.145.67:39347)
0619 02:47:55.580662 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.580664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.580674 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:47:55.580710 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.580711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.580724 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.580789 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:55.581001 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.581559 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.582499 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.582939 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.582993 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.583000 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.583171 (+ 171us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.583234 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:47:55.583410 29265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.580509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33279 (local address 127.12.145.66:47301)
0619 02:47:55.580756 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.580766 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:47:55.580810 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:47:55.580994 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:47:55.580995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:47:55.580998 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:47:55.581064 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.581065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.581724 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.581725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.582599 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:47:55.582601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.583149 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.583150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:47:55.583225 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.583229 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:47:55.583288 (+ 59us) client_negotiation.cc:240] Negotiation successful
0619 02:47:55.583321 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":85,"thread_start_us":96,"threads_started":1}
I20260619 02:47:55.583438 28987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.580727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:47301 (local address 127.12.145.65:33279)
0619 02:47:55.580800 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.580802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.580812 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:47:55.580862 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.580863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.580874 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.580936 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:47:55.581145 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.581640 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.582678 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.583052 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.583123 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.583132 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.583307 (+ 175us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.583353 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 02:47:55.583600 29204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c423678bd4a94599ab29548be5460e41" candidate_uuid: "9da83e06ae2b461d930b30cf00dc6dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" is_pre_election: true
I20260619 02:47:55.583762 29204 raft_consensus.cc:2454] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da83e06ae2b461d930b30cf00dc6dac in term 0.
I20260619 02:47:55.583808 28933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c423678bd4a94599ab29548be5460e41" candidate_uuid: "9da83e06ae2b461d930b30cf00dc6dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475414214c3c47fe8009cf9e7cf263ac" is_pre_election: true
I20260619 02:47:55.583959 28933 raft_consensus.cc:2454] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da83e06ae2b461d930b30cf00dc6dac in term 0.
I20260619 02:47:55.583977 29005 leader_election.cc:302] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31; no voters:
I20260619 02:47:55.584115 29264 raft_consensus.cc:2781] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:47:55.584180 29264 raft_consensus.cc:482] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:47:55.584203 29264 raft_consensus.cc:3037] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:55.584883 29264 raft_consensus.cc:504] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.585018 29264 leader_election.cc:288] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [CANDIDATE]: Term 1 election: Requested vote from peers b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347), 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279)
I20260619 02:47:55.585188 28933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c423678bd4a94599ab29548be5460e41" candidate_uuid: "9da83e06ae2b461d930b30cf00dc6dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475414214c3c47fe8009cf9e7cf263ac"
I20260619 02:47:55.585220 29204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c423678bd4a94599ab29548be5460e41" candidate_uuid: "9da83e06ae2b461d930b30cf00dc6dac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31"
I20260619 02:47:55.585289 29204 raft_consensus.cc:3037] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:55.585294 28933 raft_consensus.cc:3037] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:47:55.585954 29204 raft_consensus.cc:2454] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da83e06ae2b461d930b30cf00dc6dac in term 1.
I20260619 02:47:55.586107 29005 leader_election.cc:302] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31; no voters:
I20260619 02:47:55.586203 29264 raft_consensus.cc:2781] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:47:55.586336 29264 raft_consensus.cc:686] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 1 LEADER]: Becoming Leader. State: Replica: 9da83e06ae2b461d930b30cf00dc6dac, State: Running, Role: LEADER
I20260619 02:47:55.586431 29264 consensus_queue.cc:237] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:47:55.586485 28933 raft_consensus.cc:2454] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da83e06ae2b461d930b30cf00dc6dac in term 1.
I20260619 02:47:55.587349 28790 catalog_manager.cc:5495] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66). New cstate: current_term: 1 leader_uuid: "9da83e06ae2b461d930b30cf00dc6dac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } health_report { overall_health: UNKNOWN } } }
W20260619 02:47:55.597076 28980 tablet.cc:2369] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:47:55.605760 29257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.603501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48320 (local address 127.12.145.66:34895)
0619 02:47:55.603566 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0619 02:47:55.603568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:47:55.603574 (+ 6us) server_negotiation.cc:407] Connection header received
0619 02:47:55.603603 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:47:55.603604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:47:55.603619 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:47:55.603679 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:47:55.603787 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.604254 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.604999 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:47:55.605180 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:47:55.605241 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:47:55.605411 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:47:55.605507 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:47:55.605567 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:47:55.605614 (+ 47us) server_negotiation.cc:299] Negotiation successful
0619 02:47:55.605631 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:47:55.607556 29204 raft_consensus.cc:1261] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 FOLLOWER]: Refusing update from remote peer 9da83e06ae2b461d930b30cf00dc6dac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:55.607560 28933 raft_consensus.cc:1261] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Refusing update from remote peer 9da83e06ae2b461d930b30cf00dc6dac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:47:55.607949 29266 consensus_queue.cc:1035] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:55.608088 29264 consensus_queue.cc:1035] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [LEADER]: Connected to new peer: Peer: permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:47:55.609858 29269 mvcc.cc:205] Tried to move back new op lower bound from 7298405480885653504 to 7298405480802807808. Current Snapshot: MvccSnapshot[applied={T|T < 7298405480885653504}]
I20260619 02:47:55.610064 29270 mvcc.cc:205] Tried to move back new op lower bound from 7298405480885653504 to 7298405480802807808. Current Snapshot: MvccSnapshot[applied={T|T < 7298405480885653504}]
I20260619 02:47:55.610651 29272 mvcc.cc:205] Tried to move back new op lower bound from 7298405480885653504 to 7298405480802807808. Current Snapshot: MvccSnapshot[applied={T|T < 7298405480885653504}]
I20260619 02:47:55.612650 28790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:55.612748 28790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:47:55.613523 28790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Sending DeleteTablet for 3 replicas of tablet c423678bd4a94599ab29548be5460e41
I20260619 02:47:55.613843 28913 tablet_service.cc:1514] Processing DeleteTablet for tablet c423678bd4a94599ab29548be5460e41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:55 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:43674
I20260619 02:47:55.613850 29184 tablet_service.cc:1514] Processing DeleteTablet for tablet c423678bd4a94599ab29548be5460e41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:55 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:50852
I20260619 02:47:55.613847 29051 tablet_service.cc:1514] Processing DeleteTablet for tablet c423678bd4a94599ab29548be5460e41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:47:55 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:48308
I20260619 02:47:55.614022 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28828
I20260619 02:47:55.614040 28988 tablet_replica.cc:330] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: stopping tablet replica
I20260619 02:47:55.614097 28988 raft_consensus.cc:2229] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:55.614144 28988 raft_consensus.cc:2258] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:55.614598 29280 tablet_replica.cc:330] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: stopping tablet replica
I20260619 02:47:55.614723 29280 raft_consensus.cc:2229] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:47:55.614845 29280 raft_consensus.cc:2258] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:55.614995 29279 tablet_replica.cc:330] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: stopping tablet replica
I20260619 02:47:55.615077 29279 raft_consensus.cc:2229] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:47:55.615166 29279 raft_consensus.cc:2258] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:47:55.615578 29280 ts_tablet_manager.cc:1905] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:47:55.617326 29280 ts_tablet_manager.cc:1918] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:55.617401 29280 log.cc:1196] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/c423678bd4a94599ab29548be5460e41
I20260619 02:47:55.617695 29280 ts_tablet_manager.cc:1939] T c423678bd4a94599ab29548be5460e41 P 9da83e06ae2b461d930b30cf00dc6dac: Deleting consensus metadata
I20260619 02:47:55.618090 28774 catalog_manager.cc:4841] TS 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895): tablet c423678bd4a94599ab29548be5460e41 (table test-table [id=18b4b0d14f89430ab0f2523ea7cfeef1]) successfully deleted
I20260619 02:47:55.618891 29279 ts_tablet_manager.cc:1905] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 02:47:55.619751 28774 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:33279 (error 108)
I20260619 02:47:55.620306 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28985
I20260619 02:47:55.620450 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:47:55.620294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:33279 (local address 127.0.0.1:43676)
0619 02:47:55.620342 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0619 02:47:55.620412 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:33279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260619 02:47:55.620424 29279 ts_tablet_manager.cc:1918] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:47:55.621001 29279 log.cc:1196] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/c423678bd4a94599ab29548be5460e41
I20260619 02:47:55.621209 29279 ts_tablet_manager.cc:1939] T c423678bd4a94599ab29548be5460e41 P b9be4cae3bf24d8fb830bd3f6c1fcc31: Deleting consensus metadata
W20260619 02:47:55.620857 28774 catalog_manager.cc:4584] TS 475414214c3c47fe8009cf9e7cf263ac (127.12.145.65:33279): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c423678bd4a94599ab29548be5460e41: Network error: Client connection negotiation failed: client connection to 127.12.145.65:33279: connect: Connection refused (error 111)
I20260619 02:47:55.621609 28775 catalog_manager.cc:4841] TS b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347): tablet c423678bd4a94599ab29548be5460e41 (table test-table [id=18b4b0d14f89430ab0f2523ea7cfeef1]) successfully deleted
I20260619 02:47:55.625247 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 29120
I20260619 02:47:55.629943 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 28757
I20260619 02:48:15.634944 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36035
--webserver_interface=127.12.145.126
--webserver_port=33145
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:36035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:15.714942 29282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:15.715133 29282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:15.715155 29282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:15.716223 29282 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 02:48:15.716262 29282 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 02:48:15.716275 29282 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 02:48:15.716287 29282 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:15.716300 29282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:15.716313 29282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:15.716325 29282 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:15.716341 29282 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:15.717701 29282 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:36035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:36035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=33145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:15.717885 29282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:15.718045 29282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:15.723181 29287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:15.723160 29288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:15.723160 29290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:15.723174 29282 server_base.cc:1034] running on GCE node
I20260619 02:48:15.723562 29282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:15.723850 29282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:15.724994 29282 hybrid_clock.cc:648] HybridClock initialized: now 1781837295724971 us; error 39 us; skew 500 ppm
Jun 19 02:48:15 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837295, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:15.727476 29282 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:48:15.727955 29282 webserver.cc:460] Webserver started at http://127.12.145.126:33145/ using document root <none> and password file <none>
I20260619 02:48:15.728181 29282 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:15.728250 29282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:15.729597 29282 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:15.730283 29297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:15.730454 29282 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:15.730578 29282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "4e6c45007da8447ab29389d31fb24211"
format_stamp: "Formatted at 2026-06-19 02:47:33 on dist-test-slave-fbl4"
server_key: "f4e92b3eba28a35ff539acff23d71e29"
server_key_iv: "cedf38294f58807253dcff23a5fe1d08"
server_key_version: "encryptionkey@0"
I20260619 02:48:15.730939 29282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:15.748879 29282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:15.750849 29282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:15.751015 29282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:15.754920 29282 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:36035
I20260619 02:48:15.754976 29349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:36035 every 8 connection(s)
I20260619 02:48:15.755357 29282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:15.756811 29350 sys_catalog.cc:263] Verifying existing consensus state
I20260619 02:48:15.757395 29350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Bootstrap starting.
I20260619 02:48:15.759892 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 29282
I20260619 02:48:15.760183 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:33279
--local_ip_for_outbound_sockets=127.12.145.65
--tserver_master_addrs=127.12.145.126:36035
--webserver_port=46573
--webserver_interface=127.12.145.65
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:48:15.765895 29350 log.cc:824] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:15.768210 29350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:48:15.768540 29350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Bootstrap complete.
I20260619 02:48:15.770924 29350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:48:15.771185 29350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e6c45007da8447ab29389d31fb24211, State: Initialized, Role: FOLLOWER
I20260619 02:48:15.771401 29350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:48:15.771502 29350 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:15.771555 29350 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:15.771603 29350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 2 FOLLOWER]: Advancing to term 3
I20260619 02:48:15.772655 29350 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:48:15.772782 29350 leader_election.cc:302] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e6c45007da8447ab29389d31fb24211; no voters:
I20260619 02:48:15.773000 29350 leader_election.cc:288] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260619 02:48:15.773039 29354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 02:48:15.773166 29354 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [term 3 LEADER]: Becoming Leader. State: Replica: 4e6c45007da8447ab29389d31fb24211, State: Running, Role: LEADER
I20260619 02:48:15.773329 29350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:15.773360 29354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } }
I20260619 02:48:15.773962 29356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e6c45007da8447ab29389d31fb24211. Latest consensus state: current_term: 3 leader_uuid: "4e6c45007da8447ab29389d31fb24211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } } }
I20260619 02:48:15.773947 29355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4e6c45007da8447ab29389d31fb24211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6c45007da8447ab29389d31fb24211" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 36035 } } }
I20260619 02:48:15.774058 29356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:15.774065 29355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:15.774286 29358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:15.775249 29358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:15.775398 29358 catalog_manager.cc:1259] Loaded cluster ID: c91bf6f6f0164328bed697db7b9098f1
I20260619 02:48:15.775624 29358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:15.776810 29358 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:15.776971 29358 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Loaded TSK: 0
I20260619 02:48:15.777009 29358 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4e6c45007da8447ab29389d31fb24211: Loaded TSK: 1
F20260619 02:48:15.777227 29358 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd44028f9ad google::LogMessage::Fail() at ??:0
@ 0x7fd44029288a google::LogMessage::SendToLog() at ??:0
@ 0x7fd44028f4de google::LogMessage::Flush() at ??:0
@ 0x7fd440290a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd4429fc104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd4429f9d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fd4481e91cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fd4481e948e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fd4481e9594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fd4481afc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fd4481b9ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd44215d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd442152954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd442fb66db start_thread at ??:0
@ 0x7fd43ed8d61f clone at ??:0
W20260619 02:48:15.857376 29352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:15.857585 29352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:15.857620 29352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:15.858822 29352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:15.858880 29352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:15.858929 29352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:48:15.860405 29352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:33279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=46573
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:15.860668 29352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:15.860898 29352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:15.865698 29391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:15.865698 29394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:15.865718 29392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:15.865888 29352 server_base.cc:1034] running on GCE node
I20260619 02:48:15.866057 29352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:15.866308 29352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:15.867481 29352 hybrid_clock.cc:648] HybridClock initialized: now 1781837295867465 us; error 32 us; skew 500 ppm
Jun 19 02:48:15 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837295, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:15.870095 29352 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:48:15.870606 29352 webserver.cc:460] Webserver started at http://127.12.145.65:46573/ using document root <none> and password file <none>
I20260619 02:48:15.870843 29352 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:15.870911 29352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:15.872292 29352 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:15.873027 29401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:15.873224 29352 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:15.873322 29352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "475414214c3c47fe8009cf9e7cf263ac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "9f2b99aaa0a431910fd8ea4c6959a43d"
server_key_iv: "295d0ab1d90748d574109b7ec4335488"
server_key_version: "encryptionkey@0"
I20260619 02:48:15.873677 29352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:15.888523 29352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:15.890913 29352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:15.891080 29352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:15.891304 29352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:15.891744 29408 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260619 02:48:15.893738 29352 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260619 02:48:15.893813 29352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260619 02:48:15.893887 29352 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260619 02:48:15.894483 29352 ts_tablet_manager.cc:610] Registered 1 tablets
I20260619 02:48:15.894538 29352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260619 02:48:15.894629 29408 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap starting.
I20260619 02:48:15.901746 29352 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:33279
I20260619 02:48:15.901885 29515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:33279 every 8 connection(s)
I20260619 02:48:15.902164 29352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:48:15.905525 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 29352
I20260619 02:48:15.905676 29408 log.cc:824] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:15.905881 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:34895
--local_ip_for_outbound_sockets=127.12.145.66
--tserver_master_addrs=127.12.145.126:36035
--webserver_port=45867
--webserver_interface=127.12.145.66
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:48:15.908396 29408 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 02:48:15.908711 29408 tablet_bootstrap.cc:492] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Bootstrap complete.
I20260619 02:48:15.909924 29408 ts_tablet_manager.cc:1397] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260619 02:48:15.911351 29408 raft_consensus.cc:348] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:48:15.911664 29408 raft_consensus.cc:729] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475414214c3c47fe8009cf9e7cf263ac, State: Initialized, Role: FOLLOWER
I20260619 02:48:15.911841 29408 consensus_queue.cc:260] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:48:15.912110 29408 ts_tablet_manager.cc:1428] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260619 02:48:15.983469 29518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:48:15.902911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:47661)
0619 02:48:15.903078 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:15.903130 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:15.903578 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:15.983283 (+ 79705us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":95,"threads_started":1}
W20260619 02:48:15.983675 29516 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:36035 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.126:36035: Client connection negotiation failed: client connection to 127.12.145.126:36035: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 02:48:15.984032 29518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:15.983877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:44001)
0619 02:48:15.983929 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:15.983987 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260619 02:48:15.984378 29518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:15.984262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:50919)
0619 02:48:15.984314 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:15.984352 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 02:48:15.984516 29516 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 02:48:15.989890 29520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:15.990070 29520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:15.990123 29520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:15.991338 29520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:15.991379 29520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:15.991430 29520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:48:15.992807 29520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:34895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=45867
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:15.993034 29520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:15.993299 29520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:15.998093 29526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:15.998106 29527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:15.998140 29529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:15.998246 29520 server_base.cc:1034] running on GCE node
I20260619 02:48:15.998411 29520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:15.998670 29520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:15.999866 29520 hybrid_clock.cc:648] HybridClock initialized: now 1781837295999852 us; error 23 us; skew 500 ppm
Jun 19 02:48:15 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837295, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:16.002216 29520 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:48:16.002692 29520 webserver.cc:460] Webserver started at http://127.12.145.66:45867/ using document root <none> and password file <none>
I20260619 02:48:16.002918 29520 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:16.002986 29520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:16.004222 29520 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:16.004753 29536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:16.004920 29520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:16.005023 29520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "9da83e06ae2b461d930b30cf00dc6dac"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "cec90ddd92c49f1d0f02b2b86b3ccf38"
server_key_iv: "bbbc9282033c8dbd23b924f14bd82cec"
server_key_version: "encryptionkey@0"
I20260619 02:48:16.005360 29520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:16.016944 29520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:16.018759 29520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:16.018909 29520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:16.019127 29520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:16.019430 29520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:16.019482 29520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:16.019541 29520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:16.019574 29520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:16.025336 29520 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:34895
I20260619 02:48:16.025377 29649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:34895 every 8 connection(s)
I20260619 02:48:16.025703 29520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:48:16.026716 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:16.026316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:53741)
0619 02:48:16.026460 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:16.026530 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
W20260619 02:48:16.027133 29650 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:36035 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.126:36035: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
I20260619 02:48:16.027423 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:16.027327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:42419)
0619 02:48:16.027375 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:16.027406 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260619 02:48:16.027729 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:16.027655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:44797)
0619 02:48:16.027694 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:16.027715 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260619 02:48:16.027860 29650 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 02:48:16.030977 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 29520
I20260619 02:48:16.031253 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:39347
--local_ip_for_outbound_sockets=127.12.145.67
--tserver_master_addrs=127.12.145.126:36035
--webserver_port=42321
--webserver_interface=127.12.145.67
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:35891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:16.112010 29653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:16.112201 29653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:16.112223 29653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:16.113404 29653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:16.113443 29653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:16.113494 29653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:48:16.114996 29653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:35891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:39347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=42321
--tserver_master_addrs=127.12.145.126:36035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:16.115239 29653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:16.115458 29653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:16.120150 29658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:16.120149 29661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:16.120141 29659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:16.120395 29653 server_base.cc:1034] running on GCE node
I20260619 02:48:16.120615 29653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:16.120813 29653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:16.121946 29653 hybrid_clock.cc:648] HybridClock initialized: now 1781837296121935 us; error 29 us; skew 500 ppm
Jun 19 02:48:16 dist-test-slave-fbl4 krb5kdc[28209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837296, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:16.124387 29653 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:48:16.124806 29653 webserver.cc:460] Webserver started at http://127.12.145.67:42321/ using document root <none> and password file <none>
I20260619 02:48:16.125033 29653 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:16.125080 29653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:16.126380 29653 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:48:16.127009 29668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:16.127211 29653 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:16.127305 29653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31"
format_stamp: "Formatted at 2026-06-19 02:47:34 on dist-test-slave-fbl4"
server_key: "71f2560064c235614356e74a0123f479"
server_key_iv: "cc9370a76d972e248a116bb825fd1075"
server_key_version: "encryptionkey@0"
I20260619 02:48:16.127619 29653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:16.141938 29653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:16.144382 29653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:16.144550 29653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:16.144780 29653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:16.145095 29653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:16.145129 29653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:16.145171 29653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:16.145200 29653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:16.150887 29653 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:39347
I20260619 02:48:16.150949 29781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:39347 every 8 connection(s)
I20260619 02:48:16.151327 29653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:48:16.152370 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:16.151965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:50295)
0619 02:48:16.152151 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:16.152224 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":73,"threads_started":1}
W20260619 02:48:16.152794 29782 heartbeater.cc:644] Failed to heartbeat to 127.12.145.126:36035 (0 consecutive failures): Network error: Failed to ping master at 127.12.145.126:36035: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
I20260619 02:48:16.153069 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:16.152980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:58717)
0619 02:48:16.153024 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:16.153050 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260619 02:48:16.153520 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:16.153450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:35319)
0619 02:48:16.153485 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:16.153506 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260619 02:48:16.153647 29782 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 02:48:16.156117 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 29653
I20260619 02:48:16.985064 29786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:16.984841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:34637)
0619 02:48:16.984969 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:16.984998 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":57,"threads_started":1}
I20260619 02:48:17.028340 29787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:17.028145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:43707)
0619 02:48:17.028258 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:17.028292 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":53,"threads_started":1}
I20260619 02:48:17.154117 29788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:17.153929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:41161)
0619 02:48:17.154035 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:17.154065 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
I20260619 02:48:17.762653 29789 raft_consensus.cc:482] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:17.762809 29789 raft_consensus.cc:504] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:48:17.763154 29789 leader_election.cc:288] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895), b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347)
Jun 19 02:48:17 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837295, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.67@KRBTEST.COM
Jun 19 02:48:17 dist-test-slave-fbl4 krb5kdc[28209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837295, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.66@KRBTEST.COM
I20260619 02:48:17.781332 29792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:17.763389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:44989 (local address 127.12.145.66:34895)
0619 02:48:17.763558 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:17.763571 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:17.763594 (+ 23us) server_negotiation.cc:407] Connection header received
0619 02:48:17.764139 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:17.764142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:17.764197 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:17.764345 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:17.765362 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.766786 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.768258 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.768845 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.768971 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:17.777780 (+ 8809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:17.777784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:17.777784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:17.777793 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:17.779594 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:17.779987 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:17.779990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:17.779990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:17.780093 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:17.780338 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:17.780339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:17.780339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:17.780648 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:17.780735 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:17.781085 (+ 350us) server_negotiation.cc:299] Negotiation successful
0619 02:48:17.781220 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260619 02:48:17.781337 29793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:17.763467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:45857 (local address 127.12.145.67:39347)
0619 02:48:17.763629 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:17.763635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:17.763653 (+ 18us) server_negotiation.cc:407] Connection header received
0619 02:48:17.764139 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:17.764142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:17.764197 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:17.764345 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:17.765362 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.766792 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.768257 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.768853 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.768950 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:17.777427 (+ 8477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:17.777437 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:17.777437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:17.777447 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:17.779401 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:17.779879 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:17.779882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:17.779882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:17.780028 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:17.780338 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:17.780339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:17.780339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:17.780648 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:17.780735 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:17.781085 (+ 350us) server_negotiation.cc:299] Negotiation successful
0619 02:48:17.781220 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":47,"threads_started":1}
I20260619 02:48:17.781332 29791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:17.763354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:39347 (local address 127.12.145.65:45857)
0619 02:48:17.763486 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:17.763497 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:17.763549 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:17.764412 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:17.764415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:17.764946 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:17.765237 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:17.765245 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.766903 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.766904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:17.768170 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:17.768172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.769057 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.769058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:17.769111 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:17.775820 (+ 6709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:17.775824 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:17.777313 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:17.779479 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:17.779485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:17.779487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:17.779799 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:17.780096 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:17.780097 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:17.780097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:17.780250 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:17.780722 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:17.780729 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:17.780885 (+ 156us) client_negotiation.cc:769] Sending connection context
0619 02:48:17.781017 (+ 132us) client_negotiation.cc:240] Negotiation successful
0619 02:48:17.781219 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":118,"thread_start_us":64,"threads_started":1}
I20260619 02:48:17.781410 29790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:17.763275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:34895 (local address 127.12.145.65:44989)
0619 02:48:17.763423 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:17.763433 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:17.763502 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:17.764412 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:17.764415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:17.764950 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:17.765237 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:17.765245 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.766911 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.766912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:17.768169 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:17.768172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:17.768971 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:17.768972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:17.769091 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:17.775811 (+ 6720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:17.775819 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:17.777669 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:17.779661 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:17.779662 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:17.779662 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:17.779895 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:17.780166 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:17.780166 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:17.780167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:17.780250 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:17.780722 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:17.780729 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:17.780885 (+ 156us) client_negotiation.cc:769] Sending connection context
0619 02:48:17.781017 (+ 132us) client_negotiation.cc:240] Negotiation successful
0619 02:48:17.781289 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":162,"thread_start_us":78,"threads_started":1}
W20260619 02:48:17.782188 29403 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
W20260619 02:48:17.782888 29402 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
I20260619 02:48:17.782966 29402 leader_election.cc:302] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 475414214c3c47fe8009cf9e7cf263ac; no voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31
I20260619 02:48:17.783133 29789 raft_consensus.cc:2726] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:48:17.985770 29791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:17.985605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:41657)
0619 02:48:17.985687 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:17.985727 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 02:48:18.029152 29794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:18.028954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:52827)
0619 02:48:18.029068 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:18.029114 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260619 02:48:18.154783 29795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:18.154525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:35983)
0619 02:48:18.154697 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:18.154741 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":116,"threads_started":1}
I20260619 02:48:18.986506 29796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:18.986269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:36227)
0619 02:48:18.986392 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:18.986427 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260619 02:48:19.029911 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:19.029699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:42945)
0619 02:48:19.029828 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:19.029870 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260619 02:48:19.155467 29798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:19.155253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:41815)
0619 02:48:19.155379 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:19.155421 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260619 02:48:19.819092 29799 raft_consensus.cc:482] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:19.819204 29799 raft_consensus.cc:504] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:48:19.819403 29799 leader_election.cc:288] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895), b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347)
W20260619 02:48:19.819861 29403 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
W20260619 02:48:19.819944 29402 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
I20260619 02:48:19.819984 29402 leader_election.cc:302] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 475414214c3c47fe8009cf9e7cf263ac; no voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31
I20260619 02:48:19.820061 29799 raft_consensus.cc:2726] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:48:19.987265 29800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:19.987044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:46379)
0619 02:48:19.987178 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:19.987212 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":83,"threads_started":1}
I20260619 02:48:20.030730 29801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:20.030432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:57273)
0619 02:48:20.030595 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:20.030631 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":101,"threads_started":1}
I20260619 02:48:20.156090 29802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:20.155901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:51717)
0619 02:48:20.155998 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:20.156032 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":53,"threads_started":1}
I20260619 02:48:20.987939 29803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:20.987742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:40965)
0619 02:48:20.987862 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:20.987893 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
I20260619 02:48:21.031350 29804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:21.031141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:56747)
0619 02:48:21.031272 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:21.031309 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":55,"threads_started":1}
I20260619 02:48:21.156836 29805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:21.156616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:50131)
0619 02:48:21.156757 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:21.156794 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":99,"threads_started":1}
I20260619 02:48:21.988641 29806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:21.988392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:34943)
0619 02:48:21.988557 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:21.988594 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260619 02:48:22.031967 29807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:22.031769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:43851)
0619 02:48:22.031890 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:22.031926 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":58,"threads_started":1}
I20260619 02:48:22.157593 29808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:22.157257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:34105)
0619 02:48:22.157511 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:22.157549 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":117,"threads_started":1}
I20260619 02:48:22.882131 29809 raft_consensus.cc:482] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:22.882242 29809 raft_consensus.cc:504] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:48:22.882438 29809 leader_election.cc:288] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895), b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347)
W20260619 02:48:22.882812 29402 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
W20260619 02:48:22.882893 29403 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
I20260619 02:48:22.882957 29403 leader_election.cc:302] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 475414214c3c47fe8009cf9e7cf263ac; no voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31
I20260619 02:48:22.883049 29809 raft_consensus.cc:2726] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:48:22.989255 29810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:22.989039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:60561)
0619 02:48:22.989174 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:22.989209 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":60,"threads_started":1}
I20260619 02:48:23.032610 29811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:23.032411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:53821)
0619 02:48:23.032535 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:23.032568 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260619 02:48:23.158270 29812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:23.158029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:60127)
0619 02:48:23.158179 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:23.158228 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
I20260619 02:48:23.990069 29813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:23.989844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:59965)
0619 02:48:23.989983 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:23.990023 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":63,"threads_started":1}
I20260619 02:48:24.033222 29814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:24.033003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:44205)
0619 02:48:24.033141 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:24.033173 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260619 02:48:24.159044 29815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:24.158746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:59763)
0619 02:48:24.158939 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:24.158980 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":71,"threads_started":1}
I20260619 02:48:24.990821 29816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:24.990513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:51989)
0619 02:48:24.990735 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:24.990774 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":74,"threads_started":1}
I20260619 02:48:25.033842 29817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:25.033636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:57039)
0619 02:48:25.033759 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:25.033799 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":57,"threads_started":1}
I20260619 02:48:25.159672 29818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:25.159464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:45415)
0619 02:48:25.159598 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:25.159632 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260619 02:48:25.572364 29819 raft_consensus.cc:482] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:25.572459 29819 raft_consensus.cc:504] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:48:25.572615 29819 leader_election.cc:288] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895), b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347)
W20260619 02:48:25.573022 29402 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
W20260619 02:48:25.573195 29403 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
I20260619 02:48:25.573266 29403 leader_election.cc:302] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 475414214c3c47fe8009cf9e7cf263ac; no voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31
I20260619 02:48:25.573383 29819 raft_consensus.cc:2726] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:48:25.991537 29820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:25.991316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:48159)
0619 02:48:25.991454 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:25.991491 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260619 02:48:26.034487 29821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:26.034289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:50883)
0619 02:48:26.034404 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:26.034442 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260619 02:48:26.160388 29822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:26.160141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:43615)
0619 02:48:26.160291 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:26.160336 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
I20260619 02:48:26.992146 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:26.991944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:40301)
0619 02:48:26.992062 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:26.992097 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":55,"threads_started":1}
I20260619 02:48:27.035228 29824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:27.034971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:35263)
0619 02:48:27.035134 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:27.035167 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":79,"threads_started":1}
I20260619 02:48:27.161067 29825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:27.160861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:36819)
0619 02:48:27.160974 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:27.161007 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
I20260619 02:48:27.992825 29826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:27.992613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:56017)
0619 02:48:27.992740 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:27.992777 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260619 02:48:28.035902 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:28.035681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:41939)
0619 02:48:28.035821 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:28.035856 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260619 02:48:28.161761 29828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:28.161566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:56293)
0619 02:48:28.161685 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:28.161719 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
I20260619 02:48:28.789861 29829 raft_consensus.cc:482] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:28.789973 29829 raft_consensus.cc:504] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da83e06ae2b461d930b30cf00dc6dac" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 34895 } } peers { permanent_uuid: "b9be4cae3bf24d8fb830bd3f6c1fcc31" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39347 } } peers { permanent_uuid: "475414214c3c47fe8009cf9e7cf263ac" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 33279 } }
I20260619 02:48:28.790165 29829 leader_election.cc:288] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895), b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347)
W20260619 02:48:28.790588 29402 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9da83e06ae2b461d930b30cf00dc6dac (127.12.145.66:34895): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
W20260619 02:48:28.790652 29403 leader_election.cc:341] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b9be4cae3bf24d8fb830bd3f6c1fcc31 (127.12.145.67:39347): Not found: Tablet not found: c423678bd4a94599ab29548be5460e41
I20260619 02:48:28.790722 29403 leader_election.cc:302] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 475414214c3c47fe8009cf9e7cf263ac; no voters: 9da83e06ae2b461d930b30cf00dc6dac, b9be4cae3bf24d8fb830bd3f6c1fcc31
I20260619 02:48:28.790796 29829 raft_consensus.cc:2726] T c423678bd4a94599ab29548be5460e41 P 475414214c3c47fe8009cf9e7cf263ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 02:48:28.993464 29830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:28.993269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:52039)
0619 02:48:28.993386 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:28.993419 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260619 02:48:29.036580 29831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:29.036382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:35711)
0619 02:48:29.036507 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:29.036535 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260619 02:48:29.162395 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:29.162201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:54851)
0619 02:48:29.162315 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:29.162350 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
I20260619 02:48:29.994071 29833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:29.993869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:50875)
0619 02:48:29.993990 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:29.994025 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":54,"threads_started":1}
I20260619 02:48:30.037230 29834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:30.037008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:50063)
0619 02:48:30.037143 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:30.037180 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260619 02:48:30.163058 29835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:30.162855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:39467)
0619 02:48:30.162977 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:30.163013 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260619 02:48:30.994848 29836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:30.994658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.65:56307)
0619 02:48:30.994766 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:30.994802 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":52,"threads_started":1}
I20260619 02:48:31.038074 29837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:31.037835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.66:53469)
0619 02:48:31.037978 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:31.038027 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":59,"threads_started":1}
I20260619 02:48:31.157859 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 29352
I20260619 02:48:31.162634 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 29520
I20260619 02:48:31.164194 29838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:31.163941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:36035 (local address 127.12.145.67:40083)
0619 02:48:31.164076 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:31.164151 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.126:36035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":55,"threads_started":1}
I20260619 02:48:31.166929 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 29653
2026-06-19T02:48:31Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58489 ms)
[----------] 30 tests from SecurityITest (256219 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:31 dist-test-slave-fbl4 krb5kdc[29841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:31 dist-test-slave-fbl4 krb5kdc[29841](info): set up 2 sockets
Jun 19 02:48:31 dist-test-slave-fbl4 krb5kdc[29841](info): commencing operation
krb5kdc: starting...
W20260619 02:48:32.210253 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:48:32.323473 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33351
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:33351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:32.415172 29854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:32.415395 29854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:32.415431 29854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:32.416690 29854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:32.416756 29854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:32.416782 29854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:32.416812 29854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:32.416838 29854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:32.418265 29854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:33351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:32.418530 29854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:32.418777 29854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:32.423604 29860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:32.423629 29862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:32.423647 29854 server_base.cc:1034] running on GCE node
W20260619 02:48:32.423635 29859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:32.424048 29854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:32.424337 29854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:32.425505 29854 hybrid_clock.cc:648] HybridClock initialized: now 1781837312425486 us; error 30 us; skew 500 ppm
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:32.428161 29854 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:48:32.428691 29854 webserver.cc:460] Webserver started at http://127.12.145.126:39505/ using document root <none> and password file <none>
I20260619 02:48:32.428963 29854 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:32.429020 29854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:32.429152 29854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:32.430241 29854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "795cd53801224550b738b808a202d470"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "dd16de9596982fe058abefed463b4c62"
server_key_iv: "8c5664e07c65c6840514c775fc5d155e"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.430660 29854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "795cd53801224550b738b808a202d470"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "dd16de9596982fe058abefed463b4c62"
server_key_iv: "8c5664e07c65c6840514c775fc5d155e"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.431923 29854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:32.432664 29869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.432819 29854 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:32.432909 29854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "795cd53801224550b738b808a202d470"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "dd16de9596982fe058abefed463b4c62"
server_key_iv: "8c5664e07c65c6840514c775fc5d155e"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.432960 29854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:32.455276 29854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:32.457515 29854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:32.457659 29854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:32.461513 29854 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:33351
I20260619 02:48:32.461589 29921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:33351 every 8 connection(s)
I20260619 02:48:32.461921 29854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:32.462845 29922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:32.465077 29922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470: Bootstrap starting.
I20260619 02:48:32.465651 29922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:32.465941 29922 log.cc:824] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:32.466701 29922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470: No bootstrap required, opened a new log
I20260619 02:48:32.467895 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 29854
I20260619 02:48:32.467983 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:32.468210 12869 external_mini_cluster.cc:1428] Setting key f73cf4bfbcb205ca7281c5c76c116648
I20260619 02:48:32.468444 29922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cd53801224550b738b808a202d470" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33351 } }
I20260619 02:48:32.468667 29922 raft_consensus.cc:374] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:32.468798 29922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cd53801224550b738b808a202d470, State: Initialized, Role: FOLLOWER
I20260619 02:48:32.468940 29922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cd53801224550b738b808a202d470" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33351 } }
I20260619 02:48:32.469039 29922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:32.469110 29922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:32.469162 29922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:32.470007 29922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cd53801224550b738b808a202d470" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33351 } }
I20260619 02:48:32.470136 29922 leader_election.cc:302] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 795cd53801224550b738b808a202d470; no voters:
I20260619 02:48:32.470301 29922 leader_election.cc:288] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:32.470469 29928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:32.470587 29922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:32.470638 29928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [term 1 LEADER]: Becoming Leader. State: Replica: 795cd53801224550b738b808a202d470, State: Running, Role: LEADER
I20260619 02:48:32.470722 29928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cd53801224550b738b808a202d470" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33351 } }
I20260619 02:48:32.471035 29928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 795cd53801224550b738b808a202d470. Latest consensus state: current_term: 1 leader_uuid: "795cd53801224550b738b808a202d470" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cd53801224550b738b808a202d470" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33351 } } }
I20260619 02:48:32.471120 29928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:32.471045 29929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "795cd53801224550b738b808a202d470" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cd53801224550b738b808a202d470" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33351 } } }
I20260619 02:48:32.471310 29934 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:32.471304 29929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:32.471899 29934 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:32.473733 29934 catalog_manager.cc:1347] Generated new cluster ID: 27bc0ec40a0c4cc3a5c3c5beb50412e9
I20260619 02:48:32.473783 29934 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:32.479828 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.468776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37184 (local address 127.12.145.126:33351)
0619 02:48:32.468976 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:32.468985 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:32.469185 (+ 200us) server_negotiation.cc:407] Connection header received
0619 02:48:32.469316 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:32.469322 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:32.469364 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:32.469502 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:32.470117 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.471569 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.472705 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.473313 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.473426 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.476136 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:32.476140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:32.476140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:32.476152 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:32.478122 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.478518 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.478521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.478521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.478660 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.478855 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.478856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.478856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.479167 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:32.479327 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:32.479409 (+ 82us) server_negotiation.cc:299] Negotiation successful
0619 02:48:32.479634 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":100,"threads_started":1}
I20260619 02:48:32.493245 29934 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:32.493930 29934 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:32.499300 29934 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470: Generated new TSK 0
I20260619 02:48:32.499471 29934 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:48:32.527030 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33351
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:32.607244 29948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:32.607439 29948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:32.607461 29948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:32.608533 29948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:32.608566 29948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:32.608592 29948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:48:32.609946 29948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:32.610131 29948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:32.610313 29948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:32.615176 29954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:32.615163 29956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:32.615168 29953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:32.615509 29948 server_base.cc:1034] running on GCE node
I20260619 02:48:32.615715 29948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:32.615903 29948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:32.617050 29948 hybrid_clock.cc:648] HybridClock initialized: now 1781837312617041 us; error 28 us; skew 500 ppm
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:32.619535 29948 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:48:32.620097 29948 webserver.cc:460] Webserver started at http://127.12.145.65:40233/ using document root <none> and password file <none>
I20260619 02:48:32.620329 29948 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:32.620394 29948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:32.620527 29948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:32.621587 29948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "ca34e3acce6440e0a6c4c1da9431829f"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "a4efeeeb5c36b0c9988ca53d375319b4"
server_key_iv: "03065b90732c3aa1e0cd6bc90a2e4dad"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.621941 29948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "ca34e3acce6440e0a6c4c1da9431829f"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "a4efeeeb5c36b0c9988ca53d375319b4"
server_key_iv: "03065b90732c3aa1e0cd6bc90a2e4dad"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.623409 29948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:32.624090 29963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.624259 29948 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:32.624354 29948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "ca34e3acce6440e0a6c4c1da9431829f"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "a4efeeeb5c36b0c9988ca53d375319b4"
server_key_iv: "03065b90732c3aa1e0cd6bc90a2e4dad"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.624439 29948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:32.645678 29948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:32.647433 29948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:32.647593 29948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:32.647816 29948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:32.648152 29948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:32.648205 29948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.648239 29948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:32.648288 29948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.654286 29948 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:43117
I20260619 02:48:32.654330 30076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:43117 every 8 connection(s)
I20260619 02:48:32.654737 29948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:32.661675 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 29948
I20260619 02:48:32.661808 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:48:32.662048 12869 external_mini_cluster.cc:1428] Setting key 8ec5c4c1761c9ae3b2a68f171d79339e
I20260619 02:48:32.664486 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.655451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:48815 (local address 127.12.145.126:33351)
0619 02:48:32.655497 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:32.655499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:32.655741 (+ 242us) server_negotiation.cc:407] Connection header received
0619 02:48:32.656262 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:32.656264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:32.656280 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:32.656343 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:32.657276 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.657809 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.658932 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.659155 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.659242 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.661264 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:32.661265 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:32.661265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:32.661274 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:32.662851 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.663351 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.663352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.663353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.663411 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.663716 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.663717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.663717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.663822 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:32.663876 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:32.664251 (+ 375us) server_negotiation.cc:299] Negotiation successful
0619 02:48:32.664364 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:48:32.664534 30079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.655436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33351 (local address 127.12.145.65:48815)
0619 02:48:32.655619 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:32.655652 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:32.656155 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:32.656410 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:32.656414 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:32.656969 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:32.657173 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:32.657178 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.657938 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.657940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:32.658844 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:32.658847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.659252 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.659253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:32.659374 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.659806 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:32.659814 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:32.661166 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:32.662929 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:32.662936 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:32.662938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:32.663253 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:32.663487 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:32.663488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:32.663489 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:32.663641 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:32.663888 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:32.663893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:32.664059 (+ 166us) client_negotiation.cc:769] Sending connection context
0619 02:48:32.664183 (+ 124us) client_negotiation.cc:240] Negotiation successful
0619 02:48:32.664363 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260619 02:48:32.665093 30077 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33351
I20260619 02:48:32.665203 30077 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:32.665391 30077 heartbeater.cc:511] Master 127.12.145.126:33351 requested a full tablet report, sending...
I20260619 02:48:32.665897 29886 ts_manager.cc:194] Registered new tserver with Master: ca34e3acce6440e0a6c4c1da9431829f (127.12.145.65:43117)
I20260619 02:48:32.666603 29886 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:48815
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:48:32.687036 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33351
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:32.767086 30082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:32.767279 30082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:32.767305 30082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:32.768457 30082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:32.768501 30082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:32.768528 30082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:48:32.769963 30082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:32.770210 30082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:32.770447 30082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:32.775537 30087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:32.775580 30088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:32.775568 30090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:32.775887 30082 server_base.cc:1034] running on GCE node
I20260619 02:48:32.776062 30082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:32.776266 30082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:32.777401 30082 hybrid_clock.cc:648] HybridClock initialized: now 1781837312777350 us; error 66 us; skew 500 ppm
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:32.779969 30082 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:48:32.780432 30082 webserver.cc:460] Webserver started at http://127.12.145.66:36811/ using document root <none> and password file <none>
I20260619 02:48:32.780635 30082 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:32.780676 30082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:32.780763 30082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:32.781746 30082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "d4659abc4fef43029e9db5d690f1959e"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "2f07e8416dd6f247985d63274cd73426"
server_key_iv: "0c8570089b3de81244fbc40a8eb198f8"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.782042 30082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "d4659abc4fef43029e9db5d690f1959e"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "2f07e8416dd6f247985d63274cd73426"
server_key_iv: "0c8570089b3de81244fbc40a8eb198f8"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.783363 30082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260619 02:48:32.784046 30097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.784241 30082 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:32.784338 30082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "d4659abc4fef43029e9db5d690f1959e"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "2f07e8416dd6f247985d63274cd73426"
server_key_iv: "0c8570089b3de81244fbc40a8eb198f8"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.784416 30082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:32.793365 30082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:32.795187 30082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:32.795339 30082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:32.795547 30082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:32.795830 30082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:32.795882 30082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.795921 30082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:32.795949 30082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.801659 30082 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:43133
I20260619 02:48:32.801700 30210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:43133 every 8 connection(s)
I20260619 02:48:32.801992 30082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:32.810927 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.802674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:55401 (local address 127.12.145.126:33351)
0619 02:48:32.802717 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:32.802720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:32.802945 (+ 225us) server_negotiation.cc:407] Connection header received
0619 02:48:32.803519 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:32.803520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:32.803533 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:32.803600 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:32.804544 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.805065 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.806067 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.806285 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.806372 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.808521 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:32.808523 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:32.808523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:32.808530 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:32.809708 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.810067 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.810068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.810068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.810117 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.810339 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.810339 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.810339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.810446 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:32.810508 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:32.810798 (+ 290us) server_negotiation.cc:299] Negotiation successful
0619 02:48:32.810863 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:48:32.811121 30213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.802689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33351 (local address 127.12.145.66:55401)
0619 02:48:32.802828 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:32.802861 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:32.803409 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:32.803672 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:32.803676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:32.804246 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:32.804430 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:32.804434 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.805162 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.805163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:32.805966 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:32.805968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.806384 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.806385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:32.806516 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.807117 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:32.807125 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:32.808432 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:32.809778 (+ 1346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:32.809784 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:32.809785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:32.809992 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:32.810173 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:32.810173 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:32.810174 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:32.810272 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:32.810499 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:32.810503 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:32.810685 (+ 182us) client_negotiation.cc:769] Sending connection context
0619 02:48:32.810770 (+ 85us) client_negotiation.cc:240] Negotiation successful
0619 02:48:32.810887 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
I20260619 02:48:32.811486 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 30082
I20260619 02:48:32.811599 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:48:32.811719 30211 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33351
I20260619 02:48:32.811816 30211 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:32.811820 12869 external_mini_cluster.cc:1428] Setting key 052dc26b47fcd86db277490d66fd1e0c
I20260619 02:48:32.812003 30211 heartbeater.cc:511] Master 127.12.145.126:33351 requested a full tablet report, sending...
I20260619 02:48:32.812453 29885 ts_manager.cc:194] Registered new tserver with Master: d4659abc4fef43029e9db5d690f1959e (127.12.145.66:43133)
I20260619 02:48:32.812965 29885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:55401
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:48:32.841208 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33351
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:32.923467 30216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:32.923771 30216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:32.923799 30216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:32.924883 30216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:32.924930 30216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:32.924974 30216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:48:32.926298 30216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:33351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:32.926506 30216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:32.926734 30216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:32.931583 30221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:32.931597 30222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:32.931588 30224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:32.931830 30216 server_base.cc:1034] running on GCE node
I20260619 02:48:32.932030 30216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:32.932269 30216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:32.933434 30216 hybrid_clock.cc:648] HybridClock initialized: now 1781837312933425 us; error 38 us; skew 500 ppm
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:32.935827 30216 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:48:32.936298 30216 webserver.cc:460] Webserver started at http://127.12.145.67:33777/ using document root <none> and password file <none>
I20260619 02:48:32.936530 30216 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:32.936635 30216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:32.936779 30216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:32.937763 30216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "00e3166299f749dfb58faa1cf84e8a87"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "64b4ff7c720712e38f252175c1acc190"
server_key_iv: "fd9532e7024c4ca2bb0d5f6a83f79fd8"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.938107 30216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "00e3166299f749dfb58faa1cf84e8a87"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "64b4ff7c720712e38f252175c1acc190"
server_key_iv: "fd9532e7024c4ca2bb0d5f6a83f79fd8"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.939395 30216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:32.940078 30231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.940238 30216 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.940333 30216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "00e3166299f749dfb58faa1cf84e8a87"
format_stamp: "Formatted at 2026-06-19 02:48:32 on dist-test-slave-fbl4"
server_key: "64b4ff7c720712e38f252175c1acc190"
server_key_iv: "fd9532e7024c4ca2bb0d5f6a83f79fd8"
server_key_version: "encryptionkey@0"
I20260619 02:48:32.940409 30216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:32.966750 30216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:32.968662 30216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:32.968822 30216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:32.969061 30216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:32.969393 30216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:32.969446 30216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.969501 30216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:32.969524 30216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:32.975625 30216 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:40071
I20260619 02:48:32.975662 30344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:40071 every 8 connection(s)
I20260619 02:48:32.976002 30216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:48:32.976902 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 30216
I20260619 02:48:32.977018 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:48:32.977228 12869 external_mini_cluster.cc:1428] Setting key 4e9ed556582d38c9a50f0b5feb86ebba
Jun 19 02:48:32 dist-test-slave-fbl4 krb5kdc[29841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:32.986199 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.976680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:43239 (local address 127.12.145.126:33351)
0619 02:48:32.976764 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:32.976766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:32.976985 (+ 219us) server_negotiation.cc:407] Connection header received
0619 02:48:32.977746 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:32.977747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:32.977761 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:32.977817 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:32.979270 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.980178 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.981313 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.981520 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.981601 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.983681 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:32.983683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:32.983684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:32.983691 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:32.984863 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.985271 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.985272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.985273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.985331 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.985567 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.985568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.985568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.985684 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:32.985759 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:32.986021 (+ 262us) server_negotiation.cc:299] Negotiation successful
0619 02:48:32.986112 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 02:48:32.986382 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.976655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33351 (local address 127.12.145.67:43239)
0619 02:48:32.976840 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:32.976892 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:32.977598 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:32.977954 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:32.977959 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:32.978822 (+ 863us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:32.979162 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:32.979167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.980271 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.980272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:32.981195 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:32.981197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.981616 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.981618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:32.981742 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.982167 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:32.982175 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:32.983577 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:32.984956 (+ 1379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:32.984962 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:32.984964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:32.985181 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:32.985397 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:32.985398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:32.985398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:32.985500 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:32.985750 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:32.985757 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:32.985891 (+ 134us) client_negotiation.cc:769] Sending connection context
0619 02:48:32.985999 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 02:48:32.986154 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260619 02:48:32.986841 30345 heartbeater.cc:347] Connected to a master server at 127.12.145.126:33351
I20260619 02:48:32.986948 30345 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:32.987181 30345 heartbeater.cc:511] Master 127.12.145.126:33351 requested a full tablet report, sending...
I20260619 02:48:32.987532 29885 ts_manager.cc:194] Registered new tserver with Master: 00e3166299f749dfb58faa1cf84e8a87 (127.12.145.67:40071)
I20260619 02:48:32.987893 29885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:43239
I20260619 02:48:32.988866 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:48:32.995849 29926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:32.990064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37196 (local address 127.12.145.126:33351)
0619 02:48:32.990123 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:32.990125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:32.990261 (+ 136us) server_negotiation.cc:407] Connection header received
0619 02:48:32.990340 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:32.990341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:32.990350 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:32.990414 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:32.991038 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.991483 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.992249 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:32.992433 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:32.992509 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:32.993570 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:32.993572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:32.993572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:32.993579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:32.994720 (+ 1141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.995067 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.995068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.995068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.995139 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:32.995334 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:32.995334 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:32.995335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:32.995471 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:32.995572 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:32.995684 (+ 112us) server_negotiation.cc:299] Negotiation successful
0619 02:48:32.995756 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:48:32.997387 29885 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:48:32.999133 29885 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:48:33.005336 30356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.001571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:40071 (local address 127.0.0.1:59208)
0619 02:48:33.001715 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.001743 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.001827 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.002094 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.002097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.002100 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.002166 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.002167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.003211 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.003212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.004101 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.004103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.005064 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.005065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.005143 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.005156 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.005219 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.005269 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260619 02:48:33.005664 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.001665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59208 (local address 127.12.145.67:40071)
0619 02:48:33.001830 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.001836 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.001846 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:48:33.001919 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.001921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.001936 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.002008 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.002245 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.003108 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.004186 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.004910 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.004979 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.005031 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.005532 (+ 501us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.005572 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
I20260619 02:48:33.005903 30358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.001789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:43117 (local address 127.0.0.1:53898)
0619 02:48:33.001888 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.001898 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.001944 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.002567 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.002568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.002570 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.002622 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.002623 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.003982 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.003983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.004877 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.004880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.005704 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.005705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.005773 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.005777 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.005832 (+ 55us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.005860 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":3,"thread_start_us":66,"threads_started":1}
I20260619 02:48:33.005986 30361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.002174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53898 (local address 127.12.145.65:43117)
0619 02:48:33.002361 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.002366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.002376 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:48:33.002416 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.002419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.002437 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.002705 (+ 268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.002783 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.003873 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.004972 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.005621 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.005686 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.005735 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.005857 (+ 122us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.005899 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260619 02:48:33.006305 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.001954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:43133 (local address 127.0.0.1:40248)
0619 02:48:33.002072 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.002081 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.002146 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.002622 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.002622 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.002624 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.002666 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.002667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.004019 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.004020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.005151 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.005152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.006081 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.006082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.006155 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.006158 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.006208 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.006245 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
I20260619 02:48:33.006697 30279 tablet_service.cc:1467] Processing CreateTablet for tablet 40d4a3421ea949fdb5e25b2f5f9d77da (DEFAULT_TABLE table=test-table [id=27ae6758a5c1407c978ac96938fed130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:33.006897 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.002065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40248 (local address 127.12.145.66:43133)
0619 02:48:33.002412 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.002415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.002424 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:33.002458 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.002461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.002477 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.002748 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.002822 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.003896 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.005233 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.005976 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.006468 (+ 492us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.006537 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.006589 (+ 52us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.006635 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":86,"threads_started":1}
I20260619 02:48:33.007089 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d4a3421ea949fdb5e25b2f5f9d77da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:33.007105 30011 tablet_service.cc:1467] Processing CreateTablet for tablet 40d4a3421ea949fdb5e25b2f5f9d77da (DEFAULT_TABLE table=test-table [id=27ae6758a5c1407c978ac96938fed130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:33.007428 30011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d4a3421ea949fdb5e25b2f5f9d77da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:33.007484 30145 tablet_service.cc:1467] Processing CreateTablet for tablet 40d4a3421ea949fdb5e25b2f5f9d77da (DEFAULT_TABLE table=test-table [id=27ae6758a5c1407c978ac96938fed130]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:33.007764 30145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d4a3421ea949fdb5e25b2f5f9d77da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:33.009487 30362 tablet_bootstrap.cc:492] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Bootstrap starting.
I20260619 02:48:33.010056 30362 tablet_bootstrap.cc:654] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:33.010478 30362 log.cc:824] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:33.010732 30363 tablet_bootstrap.cc:492] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f: Bootstrap starting.
I20260619 02:48:33.011303 30362 tablet_bootstrap.cc:492] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: No bootstrap required, opened a new log
I20260619 02:48:33.011366 30363 tablet_bootstrap.cc:654] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:33.011386 30362 ts_tablet_manager.cc:1397] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:33.011902 30363 log.cc:824] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:33.012629 30363 tablet_bootstrap.cc:492] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f: No bootstrap required, opened a new log
I20260619 02:48:33.012701 30363 ts_tablet_manager.cc:1397] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:33.013458 30362 raft_consensus.cc:348] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.013648 30362 raft_consensus.cc:374] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:33.013685 30362 raft_consensus.cc:729] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3166299f749dfb58faa1cf84e8a87, State: Initialized, Role: FOLLOWER
I20260619 02:48:33.013798 30362 consensus_queue.cc:260] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.014050 30362 ts_tablet_manager.cc:1428] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:48:33.014068 30345 heartbeater.cc:503] Master 127.12.145.126:33351 was elected leader, sending a full tablet report...
I20260619 02:48:33.014252 30365 tablet_bootstrap.cc:492] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e: Bootstrap starting.
I20260619 02:48:33.014914 30365 tablet_bootstrap.cc:654] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:33.014931 30363 raft_consensus.cc:348] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.015132 30363 raft_consensus.cc:374] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:33.015180 30363 raft_consensus.cc:729] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca34e3acce6440e0a6c4c1da9431829f, State: Initialized, Role: FOLLOWER
I20260619 02:48:33.015311 30363 consensus_queue.cc:260] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.015475 30365 log.cc:824] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:33.015610 30077 heartbeater.cc:503] Master 127.12.145.126:33351 was elected leader, sending a full tablet report...
I20260619 02:48:33.015818 30363 ts_tablet_manager.cc:1428] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:48:33.016186 30365 tablet_bootstrap.cc:492] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e: No bootstrap required, opened a new log
I20260619 02:48:33.016271 30365 ts_tablet_manager.cc:1397] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:33.017657 30365 raft_consensus.cc:348] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.017786 30365 raft_consensus.cc:374] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:33.017807 30365 raft_consensus.cc:729] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4659abc4fef43029e9db5d690f1959e, State: Initialized, Role: FOLLOWER
I20260619 02:48:33.017879 30365 consensus_queue.cc:260] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.018056 30365 ts_tablet_manager.cc:1428] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:33.018136 30211 heartbeater.cc:503] Master 127.12.145.126:33351 was elected leader, sending a full tablet report...
I20260619 02:48:33.038082 30367 raft_consensus.cc:482] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:33.038273 30367 raft_consensus.cc:504] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.038725 30367 leader_election.cc:288] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca34e3acce6440e0a6c4c1da9431829f (127.12.145.65:43117), d4659abc4fef43029e9db5d690f1959e (127.12.145.66:43133)
I20260619 02:48:33.041570 30361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.038966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:54907 (local address 127.12.145.65:43117)
0619 02:48:33.039045 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.039047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.039060 (+ 13us) server_negotiation.cc:407] Connection header received
0619 02:48:33.039170 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.039171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.039180 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.039242 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.039409 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.039893 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.040830 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.041214 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.041299 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.041309 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.041468 (+ 159us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.041505 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:48:33.041575 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.038869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:43117 (local address 127.12.145.67:54907)
0619 02:48:33.039018 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.039030 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.039077 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.039250 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.039252 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.039254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.039333 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.039334 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.039985 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.039987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.040730 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.040732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.041296 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.041297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.041385 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.041388 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.041451 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.041495 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260619 02:48:33.041713 30360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.039181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:45813 (local address 127.12.145.66:43133)
0619 02:48:33.039235 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.039238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.039247 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:33.039305 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.039306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.039316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.039367 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.039535 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.039990 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.040926 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.041347 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.041435 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.041443 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.041606 (+ 163us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.041643 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260619 02:48:33.041761 30371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.038999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:43133 (local address 127.12.145.67:45813)
0619 02:48:33.039204 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.039213 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.039252 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.039387 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.039388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.039389 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.039458 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.039459 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.040078 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.040079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.040821 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.040823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.041435 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.041436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.041507 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.041511 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.041592 (+ 81us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.041682 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":125,"threads_started":1}
I20260619 02:48:33.041929 30031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40d4a3421ea949fdb5e25b2f5f9d77da" candidate_uuid: "00e3166299f749dfb58faa1cf84e8a87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca34e3acce6440e0a6c4c1da9431829f" is_pre_election: true
I20260619 02:48:33.042052 30031 raft_consensus.cc:2454] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3166299f749dfb58faa1cf84e8a87 in term 0.
I20260619 02:48:33.042279 30234 leader_election.cc:302] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3166299f749dfb58faa1cf84e8a87, ca34e3acce6440e0a6c4c1da9431829f; no voters:
I20260619 02:48:33.042374 30165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40d4a3421ea949fdb5e25b2f5f9d77da" candidate_uuid: "00e3166299f749dfb58faa1cf84e8a87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4659abc4fef43029e9db5d690f1959e" is_pre_election: true
I20260619 02:48:33.042502 30367 raft_consensus.cc:2781] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:48:33.042512 30165 raft_consensus.cc:2454] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3166299f749dfb58faa1cf84e8a87 in term 0.
I20260619 02:48:33.042586 30367 raft_consensus.cc:482] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:48:33.042635 30367 raft_consensus.cc:3037] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:33.043380 30367 raft_consensus.cc:504] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.043535 30367 leader_election.cc:288] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [CANDIDATE]: Term 1 election: Requested vote from peers ca34e3acce6440e0a6c4c1da9431829f (127.12.145.65:43117), d4659abc4fef43029e9db5d690f1959e (127.12.145.66:43133)
I20260619 02:48:33.043726 30031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40d4a3421ea949fdb5e25b2f5f9d77da" candidate_uuid: "00e3166299f749dfb58faa1cf84e8a87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca34e3acce6440e0a6c4c1da9431829f"
I20260619 02:48:33.043776 30165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40d4a3421ea949fdb5e25b2f5f9d77da" candidate_uuid: "00e3166299f749dfb58faa1cf84e8a87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4659abc4fef43029e9db5d690f1959e"
I20260619 02:48:33.043799 30031 raft_consensus.cc:3037] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:33.043864 30165 raft_consensus.cc:3037] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:33.044533 30031 raft_consensus.cc:2454] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3166299f749dfb58faa1cf84e8a87 in term 1.
I20260619 02:48:33.044694 30234 leader_election.cc:302] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3166299f749dfb58faa1cf84e8a87, ca34e3acce6440e0a6c4c1da9431829f; no voters:
I20260619 02:48:33.044744 30165 raft_consensus.cc:2454] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3166299f749dfb58faa1cf84e8a87 in term 1.
I20260619 02:48:33.044804 30367 raft_consensus.cc:2781] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:33.044973 30367 raft_consensus.cc:686] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 1 LEADER]: Becoming Leader. State: Replica: 00e3166299f749dfb58faa1cf84e8a87, State: Running, Role: LEADER
I20260619 02:48:33.045081 30367 consensus_queue.cc:237] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } }
I20260619 02:48:33.045897 29885 catalog_manager.cc:5495] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e3166299f749dfb58faa1cf84e8a87 (127.12.145.67). New cstate: current_term: 1 leader_uuid: "00e3166299f749dfb58faa1cf84e8a87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3166299f749dfb58faa1cf84e8a87" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 } health_report { overall_health: UNKNOWN } } }
I20260619 02:48:33.051728 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.049674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59214 (local address 127.12.145.67:40071)
0619 02:48:33.049730 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.049732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.049740 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:48:33.049775 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.049776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.049790 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.049846 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:48:33.049929 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.050368 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.051116 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.051291 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.051345 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.051452 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:48:33.051553 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:48:33.051608 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.051648 (+ 40us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.051663 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260619 02:48:33.052475 30212 tablet.cc:2369] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:48:33.053385 30031 raft_consensus.cc:1261] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 1 FOLLOWER]: Refusing update from remote peer 00e3166299f749dfb58faa1cf84e8a87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:33.053385 30165 raft_consensus.cc:1261] T 40d4a3421ea949fdb5e25b2f5f9d77da P d4659abc4fef43029e9db5d690f1959e [term 1 FOLLOWER]: Refusing update from remote peer 00e3166299f749dfb58faa1cf84e8a87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:33.053735 30367 consensus_queue.cc:1035] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca34e3acce6440e0a6c4c1da9431829f" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:33.053861 30372 consensus_queue.cc:1035] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4659abc4fef43029e9db5d690f1959e" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:33.056525 30377 mvcc.cc:205] Tried to move back new op lower bound from 7298405634264203264 to 7298405634233327616. Current Snapshot: MvccSnapshot[applied={T|T < 7298405634264203264}]
I20260619 02:48:33.056643 30376 mvcc.cc:205] Tried to move back new op lower bound from 7298405634264203264 to 7298405634233327616. Current Snapshot: MvccSnapshot[applied={T|T < 7298405634264203264}]
I20260619 02:48:33.058804 29886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:33.058897 29886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:33.059613 29886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 795cd53801224550b738b808a202d470: Sending DeleteTablet for 3 replicas of tablet 40d4a3421ea949fdb5e25b2f5f9d77da
I20260619 02:48:33.059948 30279 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d4a3421ea949fdb5e25b2f5f9d77da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:33 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:59208
I20260619 02:48:33.059967 30011 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d4a3421ea949fdb5e25b2f5f9d77da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:33 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:53898
I20260619 02:48:33.060067 30145 tablet_service.cc:1514] Processing DeleteTablet for tablet 40d4a3421ea949fdb5e25b2f5f9d77da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:33 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:40248
I20260619 02:48:33.060194 30385 tablet_replica.cc:330] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: stopping tablet replica
I20260619 02:48:33.060223 30386 tablet_replica.cc:330] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f: stopping tablet replica
I20260619 02:48:33.060299 30385 raft_consensus.cc:2229] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:48:33.060313 30386 raft_consensus.cc:2229] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:33.060389 30385 raft_consensus.cc:2258] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:33.060405 30386 raft_consensus.cc:2258] T 40d4a3421ea949fdb5e25b2f5f9d77da P ca34e3acce6440e0a6c4c1da9431829f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:33.060495 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 29948
I20260619 02:48:33.062315 30385 ts_tablet_manager.cc:1905] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:33.064285 30385 ts_tablet_manager.cc:1918] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:33.064361 30385 log.cc:1196] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/40d4a3421ea949fdb5e25b2f5f9d77da
I20260619 02:48:33.064635 30385 ts_tablet_manager.cc:1939] T 40d4a3421ea949fdb5e25b2f5f9d77da P 00e3166299f749dfb58faa1cf84e8a87: Deleting consensus metadata
I20260619 02:48:33.065079 29872 catalog_manager.cc:4841] TS 00e3166299f749dfb58faa1cf84e8a87 (127.12.145.67:40071): tablet 40d4a3421ea949fdb5e25b2f5f9d77da (table test-table [id=27ae6758a5c1407c978ac96938fed130]) successfully deleted
W20260619 02:48:33.066123 29872 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:43117 (error 108)
I20260619 02:48:33.066651 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.066492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:43117 (local address 127.0.0.1:53910)
0619 02:48:33.066572 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.066615 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:43117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260619 02:48:33.066810 29872 catalog_manager.cc:4584] TS ca34e3acce6440e0a6c4c1da9431829f (127.12.145.65:43117): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 40d4a3421ea949fdb5e25b2f5f9d77da: Network error: Client connection negotiation failed: client connection to 127.12.145.65:43117: connect: Connection refused (error 111)
I20260619 02:48:33.066906 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 30082
I20260619 02:48:33.073473 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 30216
I20260619 02:48:33.073638 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.073496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:43133 (local address 127.0.0.1:40264)
0619 02:48:33.073568 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.073600 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.66:43133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260619 02:48:33.078092 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 29854
2026-06-19T02:48:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1910 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-06-19T02:48:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:33Z Disabled control of system clock
I20260619 02:48:33.105569 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:42357
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:45845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:42357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 02:48:33.185427 30392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:33.185631 30392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:33.185652 30392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:33.186748 30392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:33.186784 30392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:33.186796 30392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:33.186808 30392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:33.186820 30392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:33.188092 30392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:45845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:42357
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:42357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:33.188277 30392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:33.188498 30392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:33.193248 30400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:33.193243 30398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:33.193295 30397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:33.193462 30392 server_base.cc:1034] running on GCE node
I20260619 02:48:33.193678 30392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:33.193969 30392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:33.195134 30392 hybrid_clock.cc:648] HybridClock initialized: now 1781837313195128 us; error 37 us; skew 500 ppm
I20260619 02:48:33.196336 30392 webserver.cc:460] Webserver started at http://127.12.145.126:45283/ using document root <none> and password file <none>
I20260619 02:48:33.196595 30392 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:33.196666 30392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:33.196820 30392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:33.197834 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "6dbb90e52e36416f9f64a49dcc910ce4"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "a23adaaded941aef7a05ab830adbc328"
server_key_iv: "f2e87840a1cc7e2e3f0a3bfba883ce41"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.198208 30392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "6dbb90e52e36416f9f64a49dcc910ce4"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "a23adaaded941aef7a05ab830adbc328"
server_key_iv: "f2e87840a1cc7e2e3f0a3bfba883ce41"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.199572 30392 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:33.200352 30406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.200532 30392 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:33.200628 30392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "6dbb90e52e36416f9f64a49dcc910ce4"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "a23adaaded941aef7a05ab830adbc328"
server_key_iv: "f2e87840a1cc7e2e3f0a3bfba883ce41"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.200708 30392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:33.221167 30392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:33.221514 30392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:33.221683 30392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:33.225828 30392 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:42357
I20260619 02:48:33.225865 30458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:42357 every 8 connection(s)
I20260619 02:48:33.226217 30392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:33.227357 30459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:33.229528 30459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4: Bootstrap starting.
I20260619 02:48:33.229966 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 30392
I20260619 02:48:33.230085 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:33.230217 30459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:33.230299 12869 external_mini_cluster.cc:1428] Setting key 8810f087c7be30c5502f81a920f1e902
I20260619 02:48:33.230578 30459 log.cc:824] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:33.231328 30459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4: No bootstrap required, opened a new log
I20260619 02:48:33.233443 30459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42357 } }
I20260619 02:48:33.233610 30459 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:33.233640 30459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dbb90e52e36416f9f64a49dcc910ce4, State: Initialized, Role: FOLLOWER
I20260619 02:48:33.233765 30459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42357 } }
I20260619 02:48:33.233834 30459 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:33.233870 30459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:33.233935 30459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:33.234489 30459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42357 } }
I20260619 02:48:33.234612 30459 leader_election.cc:302] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6dbb90e52e36416f9f64a49dcc910ce4; no voters:
I20260619 02:48:33.234799 30459 leader_election.cc:288] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:33.234858 30464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:33.235033 30464 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [term 1 LEADER]: Becoming Leader. State: Replica: 6dbb90e52e36416f9f64a49dcc910ce4, State: Running, Role: LEADER
I20260619 02:48:33.235116 30459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:33.235132 30464 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42357 } }
I20260619 02:48:33.236145 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.230801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34192 (local address 127.12.145.126:42357)
0619 02:48:33.230977 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.230987 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.231023 (+ 36us) server_negotiation.cc:407] Connection header received
0619 02:48:33.231507 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.231515 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.231572 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.231688 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:33.231919 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.232783 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.233930 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.234396 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.234496 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.235342 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:33.235346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:33.235346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:33.235549 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:33.235592 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:33.235607 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:33.235685 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.235793 (+ 108us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.235886 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260619 02:48:33.236622 30465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42357 } } }
I20260619 02:48:33.236510 30466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dbb90e52e36416f9f64a49dcc910ce4. Latest consensus state: current_term: 1 leader_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dbb90e52e36416f9f64a49dcc910ce4" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42357 } } }
I20260619 02:48:33.236673 30466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:33.236810 30465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4 [sys.catalog]: This master's current role is: LEADER
W20260619 02:48:33.237105 30478 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:48:33.237174 30478 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:48:33.237236 30479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:33.237440 30479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:33.239620 30479 catalog_manager.cc:1347] Generated new cluster ID: 77b81a4cad394368bf008b79be5328b9
I20260619 02:48:33.239670 30479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:33.251737 30479 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:33.252250 30479 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:33.264106 30479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4: Generated new TSK 0
I20260619 02:48:33.264317 30479 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:33.268918 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42357
--builtin_ntp_servers=127.12.145.84:45845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 02:48:33.350237 30483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:33.350431 30483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:33.350452 30483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:33.351594 30483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:33.351634 30483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:33.351660 30483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:48:33.352993 30483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:45845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:33.353264 30483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:33.353569 30483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:33.359540 30489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:33.359519 30491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:33.359543 30488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:33.359845 30483 server_base.cc:1034] running on GCE node
I20260619 02:48:33.360072 30483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:33.360332 30483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:33.361493 30483 hybrid_clock.cc:648] HybridClock initialized: now 1781837313361475 us; error 33 us; skew 500 ppm
I20260619 02:48:33.362818 30483 webserver.cc:460] Webserver started at http://127.12.145.65:37611/ using document root <none> and password file <none>
I20260619 02:48:33.363058 30483 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:33.363132 30483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:33.363281 30483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:33.364344 30483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "7193a2dbbd00496bb6fe795db156fc90"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "4c0af736b11bf14670284a3b02d87442"
server_key_iv: "4f764e6332d17df4d175233eb4b3287d"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.364701 30483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "7193a2dbbd00496bb6fe795db156fc90"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "4c0af736b11bf14670284a3b02d87442"
server_key_iv: "4f764e6332d17df4d175233eb4b3287d"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.365971 30483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:33.366729 30497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.366904 30483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:33.366998 30483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "7193a2dbbd00496bb6fe795db156fc90"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "4c0af736b11bf14670284a3b02d87442"
server_key_iv: "4f764e6332d17df4d175233eb4b3287d"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.367081 30483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:33.383965 30483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:33.384282 30483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:33.384435 30483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:33.384666 30483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:33.384989 30483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:33.385042 30483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.385082 30483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:33.385102 30483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.391084 30483 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:41763
I20260619 02:48:33.391141 30610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:41763 every 8 connection(s)
I20260619 02:48:33.391443 30483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:48:33.394194 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 30483
I20260619 02:48:33.394304 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:48:33.394493 12869 external_mini_cluster.cc:1428] Setting key 6620dd1c9b31db6c5a02601128f25e68
I20260619 02:48:33.395483 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42357
--builtin_ntp_servers=127.12.145.84:45845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 02:48:33.397106 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.392119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:60179 (local address 127.12.145.126:42357)
0619 02:48:33.392190 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.392192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.392442 (+ 250us) server_negotiation.cc:407] Connection header received
0619 02:48:33.392957 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.392959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.392971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.393041 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:33.393727 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.394251 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.395549 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.395811 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.395915 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.396863 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:33.396864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:33.396865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:33.396868 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:33.396883 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:33.396887 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:33.396927 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.397028 (+ 101us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.397049 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260619 02:48:33.397387 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.392129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:42357 (local address 127.12.145.65:60179)
0619 02:48:33.392314 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.392348 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.392852 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.393124 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.393128 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.393135 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:33.393631 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.393636 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.394374 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.394375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.395456 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.395459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.395930 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.395931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.396077 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.396683 (+ 606us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:33.396684 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:33.396727 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:33.396762 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:33.396947 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:33.396953 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:33.396955 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.397034 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.397145 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260619 02:48:33.397930 30611 heartbeater.cc:347] Connected to a master server at 127.12.145.126:42357
I20260619 02:48:33.398025 30611 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:33.398213 30611 heartbeater.cc:511] Master 127.12.145.126:42357 requested a full tablet report, sending...
I20260619 02:48:33.398758 30423 ts_manager.cc:194] Registered new tserver with Master: 7193a2dbbd00496bb6fe795db156fc90 (127.12.145.65:41763)
I20260619 02:48:33.399431 30423 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.65:60179
W20260619 02:48:33.475925 30614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:33.476114 30614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:33.476135 30614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:33.477254 30614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:33.477290 30614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:33.477314 30614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:48:33.478634 30614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:45845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:33.478864 30614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:33.479132 30614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:33.483912 30619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:33.483933 30622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:33.483923 30620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:33.484158 30614 server_base.cc:1034] running on GCE node
I20260619 02:48:33.484381 30614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:33.484603 30614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:33.485770 30614 hybrid_clock.cc:648] HybridClock initialized: now 1781837313485747 us; error 39 us; skew 500 ppm
I20260619 02:48:33.486984 30614 webserver.cc:460] Webserver started at http://127.12.145.66:43463/ using document root <none> and password file <none>
I20260619 02:48:33.487210 30614 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:33.487253 30614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:33.487392 30614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:33.488406 30614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "ed7db82759b042fdbd7163c12b71d820"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "49581f750ed5a790c23ad4af90439d12"
server_key_iv: "fa64d72c60af00a217162145b2d50b2d"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.488754 30614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "ed7db82759b042fdbd7163c12b71d820"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "49581f750ed5a790c23ad4af90439d12"
server_key_iv: "fa64d72c60af00a217162145b2d50b2d"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.490039 30614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:33.490855 30628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.491019 30614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:33.491113 30614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "ed7db82759b042fdbd7163c12b71d820"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "49581f750ed5a790c23ad4af90439d12"
server_key_iv: "fa64d72c60af00a217162145b2d50b2d"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.491204 30614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:33.501441 30614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:33.501686 30614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:33.501819 30614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:33.502022 30614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:33.502311 30614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:33.502362 30614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.502401 30614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:33.502427 30614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.508275 30614 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:45249
I20260619 02:48:33.508309 30741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:45249 every 8 connection(s)
I20260619 02:48:33.508606 30614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:48:33.510768 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 30614
I20260619 02:48:33.510897 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:48:33.511082 12869 external_mini_cluster.cc:1428] Setting key 6372355f24ff8dbae810fe85ba69b738
I20260619 02:48:33.512086 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42357
--builtin_ntp_servers=127.12.145.84:45845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 02:48:33.514312 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.509336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:39633 (local address 127.12.145.126:42357)
0619 02:48:33.509376 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.509378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.509589 (+ 211us) server_negotiation.cc:407] Connection header received
0619 02:48:33.510009 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.510010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.510020 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.510067 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:33.510757 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.511424 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.512855 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.513049 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.513106 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.514004 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:33.514006 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:33.514006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:33.514011 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:33.514025 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:33.514029 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:33.514085 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.514207 (+ 122us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.514233 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:48:33.514518 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.509325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:42357 (local address 127.12.145.66:39633)
0619 02:48:33.509469 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.509498 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.509933 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.510115 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.510118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.510126 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:33.510675 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.510682 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.511517 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.511518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.512776 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.512779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.513130 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.513131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.513291 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.513867 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:33.513868 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:33.513894 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:33.513915 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:33.514089 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:33.514098 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:33.514101 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.514208 (+ 107us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.514303 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":63,"threads_started":1}
I20260619 02:48:33.514981 30742 heartbeater.cc:347] Connected to a master server at 127.12.145.126:42357
I20260619 02:48:33.515069 30742 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:33.515265 30742 heartbeater.cc:511] Master 127.12.145.126:42357 requested a full tablet report, sending...
I20260619 02:48:33.515640 30423 ts_manager.cc:194] Registered new tserver with Master: ed7db82759b042fdbd7163c12b71d820 (127.12.145.66:45249)
I20260619 02:48:33.516008 30423 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.66:39633
W20260619 02:48:33.590807 30745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:33.591012 30745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:33.591043 30745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:33.592116 30745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:33.592180 30745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:33.592221 30745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:48:33.593611 30745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:45845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:42357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:33.593851 30745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:33.594121 30745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:33.598855 30753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:33.598853 30751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:33.598887 30745 server_base.cc:1034] running on GCE node
W20260619 02:48:33.599071 30750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:33.599296 30745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:33.599548 30745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:33.600703 30745 hybrid_clock.cc:648] HybridClock initialized: now 1781837313600686 us; error 27 us; skew 500 ppm
I20260619 02:48:33.601914 30745 webserver.cc:460] Webserver started at http://127.12.145.67:44069/ using document root <none> and password file <none>
I20260619 02:48:33.602180 30745 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:33.602252 30745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:33.602393 30745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:33.603593 30745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "3b561217f66040a5b732b3b7a40cd6c5"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "0013e0ea6b70f104b7716e7c6796bd1b"
server_key_iv: "9cffa7cc43f615faa5794bf871b3a032"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.603951 30745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "3b561217f66040a5b732b3b7a40cd6c5"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "0013e0ea6b70f104b7716e7c6796bd1b"
server_key_iv: "9cffa7cc43f615faa5794bf871b3a032"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.605208 30745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:48:33.605975 30759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.606163 30745 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:33.606257 30745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "3b561217f66040a5b732b3b7a40cd6c5"
format_stamp: "Formatted at 2026-06-19 02:48:33 on dist-test-slave-fbl4"
server_key: "0013e0ea6b70f104b7716e7c6796bd1b"
server_key_iv: "9cffa7cc43f615faa5794bf871b3a032"
server_key_version: "encryptionkey@0"
I20260619 02:48:33.606336 30745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:33.615522 30745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:33.615783 30745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:33.615923 30745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:33.616130 30745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:33.616421 30745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:33.616472 30745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.616511 30745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:33.616537 30745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:33.622030 30745 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:42383
I20260619 02:48:33.622069 30872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:42383 every 8 connection(s)
I20260619 02:48:33.622363 30745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:48:33.627295 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.623055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:46821 (local address 127.12.145.126:42357)
0619 02:48:33.623136 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.623139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.623309 (+ 170us) server_negotiation.cc:407] Connection header received
0619 02:48:33.623762 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.623763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.623772 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.623822 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:33.624429 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.624894 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.625920 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.626153 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.626219 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.627014 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:33.627015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:33.627015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:33.627019 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:33.627033 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:33.627036 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:33.627079 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.627218 (+ 139us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.627237 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260619 02:48:33.627290 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 30745
I20260619 02:48:33.627403 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:48:33.627590 30875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.623019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:42357 (local address 127.12.145.67:46821)
0619 02:48:33.623199 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.623230 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.623660 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.623871 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.623874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.623882 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:33.624346 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.624350 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.624967 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.624967 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.625843 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.625846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.626277 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.626278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.626392 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.626889 (+ 497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:33.626889 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:33.626915 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:33.626936 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:33.627131 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:33.627137 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:33.627140 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.627217 (+ 77us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.627329 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260619 02:48:33.627616 12869 external_mini_cluster.cc:1428] Setting key 2a39cac0415adb2e9d5b44564dbc9731
I20260619 02:48:33.628206 30873 heartbeater.cc:347] Connected to a master server at 127.12.145.126:42357
I20260619 02:48:33.628304 30873 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:33.628489 30873 heartbeater.cc:511] Master 127.12.145.126:42357 requested a full tablet report, sending...
I20260619 02:48:33.628836 30423 ts_manager.cc:194] Registered new tserver with Master: 3b561217f66040a5b732b3b7a40cd6c5 (127.12.145.67:42383)
I20260619 02:48:33.629199 30423 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.67:46821
I20260619 02:48:33.639398 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:48:33.643618 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.640727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56388 (local address 127.12.145.126:42357)
0619 02:48:33.640786 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.640789 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.640834 (+ 45us) server_negotiation.cc:407] Connection header received
0619 02:48:33.640910 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.640911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.640920 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.640978 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:33.641154 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.641649 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.642395 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.642689 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.642772 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.643369 (+ 597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:33.643370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:33.643370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:33.643375 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:33.643388 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:33.643391 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:33.643446 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.643516 (+ 70us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.643538 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:48:33.645056 30423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:48:33.646592 30423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:48:33.652966 30883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.648815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39676 (local address 127.12.145.66:45249)
0619 02:48:33.649006 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.649011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.649156 (+ 145us) server_negotiation.cc:407] Connection header received
0619 02:48:33.649268 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.649270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.649307 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.649379 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.649651 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.650351 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.651757 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.652416 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.652488 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.652581 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.652831 (+ 250us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.652876 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":77,"threads_started":1}
I20260619 02:48:33.653221 30882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.648796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41763 (local address 127.0.0.1:47784)
0619 02:48:33.649076 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.649105 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.649161 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.649449 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.649452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.649457 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.649548 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.649550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.650876 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.650877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.651914 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.651917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.652925 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.652926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.652988 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.652992 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.653064 (+ 72us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.653145 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":7,"thread_start_us":79,"threads_started":1}
I20260619 02:48:33.653365 30881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.648725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:45249 (local address 127.0.0.1:39676)
0619 02:48:33.649051 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.649095 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.649181 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.649449 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.649452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.649455 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.649556 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.649558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.650444 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.650445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.651675 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.651677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.652619 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.652620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.652700 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.652712 (+ 12us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.653144 (+ 432us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.653187 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":24,"thread_start_us":63,"threads_started":1}
I20260619 02:48:33.653611 30884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.648894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47784 (local address 127.12.145.65:41763)
0619 02:48:33.649197 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.649200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.649230 (+ 30us) server_negotiation.cc:407] Connection header received
0619 02:48:33.649267 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.649269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.649285 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.649365 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.649637 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.650790 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.651999 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.652749 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.652812 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.652894 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.653478 (+ 584us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.653525 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":92,"threads_started":1}
I20260619 02:48:33.654075 30676 tablet_service.cc:1467] Processing CreateTablet for tablet aa73f5f739d54c01b8cfb08aa77fe47e (DEFAULT_TABLE table=test-table [id=7c05beabe0e244d6ade50e2c705067c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:33.654357 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.648927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42383 (local address 127.0.0.1:37146)
0619 02:48:33.649272 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.649280 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.649324 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.649578 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.649579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.649581 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.649627 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.649628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.652010 (+ 2382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.652010 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.653201 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.653204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.654136 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.654136 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.654198 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.654202 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.654258 (+ 56us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.654298 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":68,"threads_started":1}
I20260619 02:48:33.654255 30545 tablet_service.cc:1467] Processing CreateTablet for tablet aa73f5f739d54c01b8cfb08aa77fe47e (DEFAULT_TABLE table=test-table [id=7c05beabe0e244d6ade50e2c705067c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:33.654389 30886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.649006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37146 (local address 127.12.145.67:42383)
0619 02:48:33.649158 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.649162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.649382 (+ 220us) server_negotiation.cc:407] Connection header received
0619 02:48:33.649426 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.649429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.649444 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.649514 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.649689 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.650788 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.653299 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.654046 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.654128 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.654210 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.654271 (+ 61us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.654312 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260619 02:48:33.654459 30676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa73f5f739d54c01b8cfb08aa77fe47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:33.654630 30545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa73f5f739d54c01b8cfb08aa77fe47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:33.654964 30807 tablet_service.cc:1467] Processing CreateTablet for tablet aa73f5f739d54c01b8cfb08aa77fe47e (DEFAULT_TABLE table=test-table [id=7c05beabe0e244d6ade50e2c705067c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:33.655256 30807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa73f5f739d54c01b8cfb08aa77fe47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:33.657752 30887 tablet_bootstrap.cc:492] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90: Bootstrap starting.
I20260619 02:48:33.658378 30887 tablet_bootstrap.cc:654] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:33.658353 30889 tablet_bootstrap.cc:492] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Bootstrap starting.
I20260619 02:48:33.658716 30888 tablet_bootstrap.cc:492] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Bootstrap starting.
I20260619 02:48:33.658736 30887 log.cc:824] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:33.659001 30889 tablet_bootstrap.cc:654] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:33.659310 30889 log.cc:824] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:33.659359 30888 tablet_bootstrap.cc:654] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:33.659418 30887 tablet_bootstrap.cc:492] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90: No bootstrap required, opened a new log
I20260619 02:48:33.659476 30887 ts_tablet_manager.cc:1397] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260619 02:48:33.659662 30888 log.cc:824] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:33.660503 30888 tablet_bootstrap.cc:492] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: No bootstrap required, opened a new log
I20260619 02:48:33.660564 30888 ts_tablet_manager.cc:1397] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:33.661581 30889 tablet_bootstrap.cc:492] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: No bootstrap required, opened a new log
I20260619 02:48:33.661651 30889 ts_tablet_manager.cc:1397] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260619 02:48:33.661720 30887 raft_consensus.cc:348] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.661890 30887 raft_consensus.cc:374] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:33.661929 30887 raft_consensus.cc:729] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7193a2dbbd00496bb6fe795db156fc90, State: Initialized, Role: FOLLOWER
I20260619 02:48:33.662032 30887 consensus_queue.cc:260] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.662285 30887 ts_tablet_manager.cc:1428] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260619 02:48:33.662428 30611 heartbeater.cc:503] Master 127.12.145.126:42357 was elected leader, sending a full tablet report...
I20260619 02:48:33.663383 30888 raft_consensus.cc:348] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.663543 30888 raft_consensus.cc:374] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:33.663582 30888 raft_consensus.cc:729] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed7db82759b042fdbd7163c12b71d820, State: Initialized, Role: FOLLOWER
I20260619 02:48:33.663736 30888 consensus_queue.cc:260] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.664006 30888 ts_tablet_manager.cc:1428] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260619 02:48:33.664047 30742 heartbeater.cc:503] Master 127.12.145.126:42357 was elected leader, sending a full tablet report...
I20260619 02:48:33.664203 30889 raft_consensus.cc:348] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.664347 30889 raft_consensus.cc:374] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:33.664384 30889 raft_consensus.cc:729] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b561217f66040a5b732b3b7a40cd6c5, State: Initialized, Role: FOLLOWER
I20260619 02:48:33.664485 30889 consensus_queue.cc:260] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.664740 30889 ts_tablet_manager.cc:1428] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:48:33.664785 30873 heartbeater.cc:503] Master 127.12.145.126:42357 was elected leader, sending a full tablet report...
I20260619 02:48:33.688108 30893 raft_consensus.cc:482] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:33.688192 30893 raft_consensus.cc:504] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.688438 30893 leader_election.cc:288] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed7db82759b042fdbd7163c12b71d820 (127.12.145.66:45249), 3b561217f66040a5b732b3b7a40cd6c5 (127.12.145.67:42383)
I20260619 02:48:33.692170 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.688598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:45249 (local address 127.12.145.65:36859)
0619 02:48:33.688654 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.688666 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.688736 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.688866 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.688867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.688869 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.688941 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.688943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.689883 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.689883 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.691148 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.691151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.691894 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.691895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.691974 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.691980 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.692036 (+ 56us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.692088 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":22}
I20260619 02:48:33.692178 30886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.688765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:60041 (local address 127.12.145.67:42383)
0619 02:48:33.688805 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.688807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.688911 (+ 104us) server_negotiation.cc:407] Connection header received
0619 02:48:33.688969 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.688970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.688995 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.689084 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.689204 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.689893 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.691247 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.691810 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.691889 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.691896 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.692063 (+ 167us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.692101 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260619 02:48:33.692198 30883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.688697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:36859 (local address 127.12.145.66:45249)
0619 02:48:33.688743 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.688745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.688757 (+ 12us) server_negotiation.cc:407] Connection header received
0619 02:48:33.688785 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.688786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.688795 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.688845 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:33.689033 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.689810 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.691247 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.691805 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.691889 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.691897 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.692062 (+ 165us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.692103 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:48:33.692181 30896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.688697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:42383 (local address 127.12.145.65:60041)
0619 02:48:33.688843 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.688852 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:33.688897 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:33.689098 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:33.689099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:33.689101 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:33.689158 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.689159 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.689955 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.689955 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.691148 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:33.691151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.691894 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.691895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:33.691974 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.691980 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 02:48:33.692036 (+ 56us) client_negotiation.cc:240] Negotiation successful
0619 02:48:33.692087 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":12,"thread_start_us":92,"threads_started":1}
I20260619 02:48:33.692518 30827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa73f5f739d54c01b8cfb08aa77fe47e" candidate_uuid: "7193a2dbbd00496bb6fe795db156fc90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b561217f66040a5b732b3b7a40cd6c5" is_pre_election: true
I20260619 02:48:33.692538 30696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa73f5f739d54c01b8cfb08aa77fe47e" candidate_uuid: "7193a2dbbd00496bb6fe795db156fc90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7db82759b042fdbd7163c12b71d820" is_pre_election: true
I20260619 02:48:33.692665 30696 raft_consensus.cc:2454] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7193a2dbbd00496bb6fe795db156fc90 in term 0.
I20260619 02:48:33.692665 30827 raft_consensus.cc:2454] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7193a2dbbd00496bb6fe795db156fc90 in term 0.
I20260619 02:48:33.692874 30501 leader_election.cc:302] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7193a2dbbd00496bb6fe795db156fc90, ed7db82759b042fdbd7163c12b71d820; no voters:
I20260619 02:48:33.693043 30893 raft_consensus.cc:2781] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:48:33.693125 30893 raft_consensus.cc:482] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:48:33.693142 30893 raft_consensus.cc:3037] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:33.694012 30893 raft_consensus.cc:504] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.694141 30893 leader_election.cc:288] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [CANDIDATE]: Term 1 election: Requested vote from peers ed7db82759b042fdbd7163c12b71d820 (127.12.145.66:45249), 3b561217f66040a5b732b3b7a40cd6c5 (127.12.145.67:42383)
I20260619 02:48:33.694339 30696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa73f5f739d54c01b8cfb08aa77fe47e" candidate_uuid: "7193a2dbbd00496bb6fe795db156fc90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed7db82759b042fdbd7163c12b71d820"
I20260619 02:48:33.694360 30827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa73f5f739d54c01b8cfb08aa77fe47e" candidate_uuid: "7193a2dbbd00496bb6fe795db156fc90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b561217f66040a5b732b3b7a40cd6c5"
I20260619 02:48:33.694422 30827 raft_consensus.cc:3037] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:33.694423 30696 raft_consensus.cc:3037] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:33.695112 30827 raft_consensus.cc:2454] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7193a2dbbd00496bb6fe795db156fc90 in term 1.
I20260619 02:48:33.695276 30696 raft_consensus.cc:2454] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7193a2dbbd00496bb6fe795db156fc90 in term 1.
I20260619 02:48:33.695282 30501 leader_election.cc:302] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b561217f66040a5b732b3b7a40cd6c5, 7193a2dbbd00496bb6fe795db156fc90; no voters:
I20260619 02:48:33.695421 30893 raft_consensus.cc:2781] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:33.695602 30893 raft_consensus.cc:686] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 1 LEADER]: Becoming Leader. State: Replica: 7193a2dbbd00496bb6fe795db156fc90, State: Running, Role: LEADER
I20260619 02:48:33.695679 30893 consensus_queue.cc:237] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } }
I20260619 02:48:33.696430 30423 catalog_manager.cc:5495] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7193a2dbbd00496bb6fe795db156fc90 (127.12.145.65). New cstate: current_term: 1 leader_uuid: "7193a2dbbd00496bb6fe795db156fc90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7193a2dbbd00496bb6fe795db156fc90" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260619 02:48:33.709903 30884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.707539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47794 (local address 127.12.145.65:41763)
0619 02:48:33.707598 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:33.707600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:33.707607 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:48:33.707653 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:33.707654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:33.707668 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:33.707725 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:48:33.707816 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.708251 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.709086 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:33.709267 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:33.709325 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:33.709497 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:48:33.709619 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:48:33.709717 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:33.709764 (+ 47us) server_negotiation.cc:299] Negotiation successful
0619 02:48:33.709790 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:48:33.711634 30696 raft_consensus.cc:1261] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 1 FOLLOWER]: Refusing update from remote peer 7193a2dbbd00496bb6fe795db156fc90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:33.711651 30827 raft_consensus.cc:1261] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 1 FOLLOWER]: Refusing update from remote peer 7193a2dbbd00496bb6fe795db156fc90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:33.711977 30897 consensus_queue.cc:1035] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b561217f66040a5b732b3b7a40cd6c5" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 42383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:33.712097 30893 consensus_queue.cc:1035] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed7db82759b042fdbd7163c12b71d820" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:33.715085 30902 mvcc.cc:205] Tried to move back new op lower bound from 7298405636960321536 to 7298405636897968128. Current Snapshot: MvccSnapshot[applied={T|T < 7298405636960321536}]
I20260619 02:48:33.717438 30423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:33.717525 30423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:33.718329 30423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6dbb90e52e36416f9f64a49dcc910ce4: Sending DeleteTablet for 3 replicas of tablet aa73f5f739d54c01b8cfb08aa77fe47e
I20260619 02:48:33.718694 30676 tablet_service.cc:1514] Processing DeleteTablet for tablet aa73f5f739d54c01b8cfb08aa77fe47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:33 UTC) from {username='slave'} at 127.0.0.1:39676
I20260619 02:48:33.718745 30545 tablet_service.cc:1514] Processing DeleteTablet for tablet aa73f5f739d54c01b8cfb08aa77fe47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:33 UTC) from {username='slave'} at 127.0.0.1:47784
I20260619 02:48:33.718778 30807 tablet_service.cc:1514] Processing DeleteTablet for tablet aa73f5f739d54c01b8cfb08aa77fe47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:33 UTC) from {username='slave'} at 127.0.0.1:37146
I20260619 02:48:33.718924 30911 tablet_replica.cc:330] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90: stopping tablet replica
I20260619 02:48:33.719020 30911 raft_consensus.cc:2229] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:48:33.719020 30912 tablet_replica.cc:330] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: stopping tablet replica
I20260619 02:48:33.719115 30910 tablet_replica.cc:330] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: stopping tablet replica
I20260619 02:48:33.719147 30911 raft_consensus.cc:2258] T aa73f5f739d54c01b8cfb08aa77fe47e P 7193a2dbbd00496bb6fe795db156fc90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:33.719200 30910 raft_consensus.cc:2229] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:33.719204 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 30483
I20260619 02:48:33.719290 30910 raft_consensus.cc:2258] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:33.719709 30910 ts_tablet_manager.cc:1905] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:33.720012 30912 raft_consensus.cc:2229] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:33.720135 30912 raft_consensus.cc:2258] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:33.720532 30912 ts_tablet_manager.cc:1905] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:33.721366 30910 ts_tablet_manager.cc:1918] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:33.721444 30910 log.cc:1196] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/aa73f5f739d54c01b8cfb08aa77fe47e
I20260619 02:48:33.721693 30910 ts_tablet_manager.cc:1939] T aa73f5f739d54c01b8cfb08aa77fe47e P ed7db82759b042fdbd7163c12b71d820: Deleting consensus metadata
I20260619 02:48:33.722059 30410 catalog_manager.cc:4841] TS ed7db82759b042fdbd7163c12b71d820 (127.12.145.66:45249): tablet aa73f5f739d54c01b8cfb08aa77fe47e (table test-table [id=7c05beabe0e244d6ade50e2c705067c4]) successfully deleted
I20260619 02:48:33.722451 30912 ts_tablet_manager.cc:1918] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:33.722661 30912 log.cc:1196] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/aa73f5f739d54c01b8cfb08aa77fe47e
I20260619 02:48:33.722910 30912 ts_tablet_manager.cc:1939] T aa73f5f739d54c01b8cfb08aa77fe47e P 3b561217f66040a5b732b3b7a40cd6c5: Deleting consensus metadata
I20260619 02:48:33.723275 30410 catalog_manager.cc:4841] TS 3b561217f66040a5b732b3b7a40cd6c5 (127.12.145.67:42383): tablet aa73f5f739d54c01b8cfb08aa77fe47e (table test-table [id=7c05beabe0e244d6ade50e2c705067c4]) successfully deleted
W20260619 02:48:33.726438 30408 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:41763 (error 108)
I20260619 02:48:33.726902 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:33.726769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:41763 (local address 127.0.0.1:47800)
0619 02:48:33.726821 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:33.726865 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:41763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260619 02:48:33.726926 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 30614
W20260619 02:48:33.727041 30408 catalog_manager.cc:4584] TS 7193a2dbbd00496bb6fe795db156fc90 (127.12.145.65:41763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa73f5f739d54c01b8cfb08aa77fe47e: Network error: Client connection negotiation failed: client connection to 127.12.145.65:41763: connect: Connection refused (error 111)
I20260619 02:48:33.731490 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 30745
I20260619 02:48:33.736045 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 30392
2026-06-19T02:48:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (656 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:33 dist-test-slave-fbl4 krb5kdc[30916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:33 dist-test-slave-fbl4 krb5kdc[30916](info): set up 2 sockets
Jun 19 02:48:33 dist-test-slave-fbl4 krb5kdc[30916](info): commencing operation
krb5kdc: starting...
W20260619 02:48:34.774935 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:34 dist-test-slave-fbl4 krb5kdc[30916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:48:34.893730 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:43355
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:43355
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:34.974493 30929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:34.974792 30929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:34.974831 30929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:34.975958 30929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:34.976022 30929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:34.976046 30929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:34.976082 30929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:34.976109 30929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:34.977560 30929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:43355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:43355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:34.977825 30929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:34.978045 30929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:34.982730 30934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:34.982847 30929 server_base.cc:1034] running on GCE node
W20260619 02:48:34.982775 30935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:34.982753 30937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:34.983186 30929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:34.983429 30929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:34.984578 30929 hybrid_clock.cc:648] HybridClock initialized: now 1781837314984564 us; error 29 us; skew 500 ppm
Jun 19 02:48:34 dist-test-slave-fbl4 krb5kdc[30916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837314, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:34.987900 30929 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:48:34.988322 30929 webserver.cc:460] Webserver started at http://127.12.145.126:36449/ using document root <none> and password file <none>
I20260619 02:48:34.988584 30929 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:34.988651 30929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:34.988801 30929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:34.989826 30929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "f7fc8eaad2b142aaa00584821651e0ef"
format_stamp: "Formatted at 2026-06-19 02:48:34 on dist-test-slave-fbl4"
server_key: "4de44fc6bd37438d29af59e03b411bc7"
server_key_iv: "b302b8b8390ccd446e166c7d8581d4dd"
server_key_version: "encryptionkey@0"
I20260619 02:48:34.990185 30929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "f7fc8eaad2b142aaa00584821651e0ef"
format_stamp: "Formatted at 2026-06-19 02:48:34 on dist-test-slave-fbl4"
server_key: "4de44fc6bd37438d29af59e03b411bc7"
server_key_iv: "b302b8b8390ccd446e166c7d8581d4dd"
server_key_version: "encryptionkey@0"
I20260619 02:48:34.991740 30929 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:34.992398 30944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:34.992566 30929 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:34.992663 30929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "f7fc8eaad2b142aaa00584821651e0ef"
format_stamp: "Formatted at 2026-06-19 02:48:34 on dist-test-slave-fbl4"
server_key: "4de44fc6bd37438d29af59e03b411bc7"
server_key_iv: "b302b8b8390ccd446e166c7d8581d4dd"
server_key_version: "encryptionkey@0"
I20260619 02:48:34.992749 30929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:35.011616 30929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:35.013751 30929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:35.013926 30929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:35.017867 30929 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:43355
I20260619 02:48:35.017906 30996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:43355 every 8 connection(s)
I20260619 02:48:35.018267 30929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:35.018466 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 30929
I20260619 02:48:35.018620 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:35.018833 12869 external_mini_cluster.cc:1428] Setting key 67ce65ec971d69a7038573ca116b31ed
I20260619 02:48:35.019340 30997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:35.022526 30997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef: Bootstrap starting.
I20260619 02:48:35.023231 30997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:35.023515 30997 log.cc:824] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:35.024250 30997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef: No bootstrap required, opened a new log
Jun 19 02:48:35 dist-test-slave-fbl4 krb5kdc[30916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:35.026753 30997 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7fc8eaad2b142aaa00584821651e0ef" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43355 } }
I20260619 02:48:35.026927 30997 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:35.027001 30997 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7fc8eaad2b142aaa00584821651e0ef, State: Initialized, Role: FOLLOWER
I20260619 02:48:35.027150 30997 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7fc8eaad2b142aaa00584821651e0ef" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43355 } }
I20260619 02:48:35.027237 30997 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:35.027283 30997 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:35.027339 30997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:35.027853 30997 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7fc8eaad2b142aaa00584821651e0ef" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43355 } }
I20260619 02:48:35.027936 30997 leader_election.cc:302] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7fc8eaad2b142aaa00584821651e0ef; no voters:
I20260619 02:48:35.028137 30997 leader_election.cc:288] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:35.028170 31002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:35.028285 31002 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [term 1 LEADER]: Becoming Leader. State: Replica: f7fc8eaad2b142aaa00584821651e0ef, State: Running, Role: LEADER
I20260619 02:48:35.028363 31002 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7fc8eaad2b142aaa00584821651e0ef" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43355 } }
I20260619 02:48:35.028401 30997 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:35.028884 31002 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7fc8eaad2b142aaa00584821651e0ef. Latest consensus state: current_term: 1 leader_uuid: "f7fc8eaad2b142aaa00584821651e0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7fc8eaad2b142aaa00584821651e0ef" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43355 } } }
I20260619 02:48:35.028980 31002 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:35.029132 31003 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7fc8eaad2b142aaa00584821651e0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7fc8eaad2b142aaa00584821651e0ef" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43355 } } }
I20260619 02:48:35.029191 31003 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef [sys.catalog]: This master's current role is: LEADER
W20260619 02:48:35.030206 31018 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:48:35.030264 31018 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:48:35.030315 31011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:35.030452 31011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:35.030516 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.019356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39914 (local address 127.12.145.126:43355)
0619 02:48:35.019532 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.019541 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.019573 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:48:35.020085 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.020095 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.020159 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.020311 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:35.020887 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.022233 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.023108 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.023752 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.023835 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.026459 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:35.026463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:35.026464 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:35.026476 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:35.028396 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.028816 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.028818 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.028819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.028927 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.029168 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.029169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.029169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.029478 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:35.030086 (+ 608us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.030174 (+ 88us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.030316 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260619 02:48:35.031883 31011 catalog_manager.cc:1347] Generated new cluster ID: cb1fb413d8ba4b05aad8596b5968576b
I20260619 02:48:35.031932 31011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:35.048213 31011 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:35.048985 31011 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:35.054399 31011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef: Generated new TSK 0
I20260619 02:48:35.054606 31011 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:48:35.085050 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43355
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:35.165501 31023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:35.165704 31023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:35.165726 31023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:35.166797 31023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:35.166831 31023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:35.166857 31023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:48:35.168198 31023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:35.168380 31023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:35.168546 31023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:35.173352 31031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:35.173360 31028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:35.173358 31029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:35.173746 31023 server_base.cc:1034] running on GCE node
I20260619 02:48:35.173974 31023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:35.174219 31023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:35.175379 31023 hybrid_clock.cc:648] HybridClock initialized: now 1781837315175365 us; error 29 us; skew 500 ppm
Jun 19 02:48:35 dist-test-slave-fbl4 krb5kdc[30916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:35.177910 31023 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:48:35.178406 31023 webserver.cc:460] Webserver started at http://127.12.145.65:35005/ using document root <none> and password file <none>
I20260619 02:48:35.178710 31023 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:35.178782 31023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:35.178918 31023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:35.180096 31023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "14d0e133732a4f748f63f09d1d4a3d4b"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "b181ec85388bfff923130b3daa78074c"
server_key_iv: "6eaa13567c0a2f25554a67c0a79a6a19"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.180387 31023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "14d0e133732a4f748f63f09d1d4a3d4b"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "b181ec85388bfff923130b3daa78074c"
server_key_iv: "6eaa13567c0a2f25554a67c0a79a6a19"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.181598 31023 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:35.182267 31038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.182448 31023 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:35.182518 31023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "14d0e133732a4f748f63f09d1d4a3d4b"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "b181ec85388bfff923130b3daa78074c"
server_key_iv: "6eaa13567c0a2f25554a67c0a79a6a19"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.182624 31023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:35.200948 31023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:35.203178 31023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:35.203284 31023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:35.203454 31023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:35.203773 31023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:35.203809 31023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.203831 31023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:35.203878 31023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.209658 31023 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:37395
I20260619 02:48:35.209721 31151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:37395 every 8 connection(s)
I20260619 02:48:35.210014 31023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:48:35 dist-test-slave-fbl4 krb5kdc[30916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:35.219027 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.210924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:50021 (local address 127.12.145.126:43355)
0619 02:48:35.211043 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.211045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.211152 (+ 107us) server_negotiation.cc:407] Connection header received
0619 02:48:35.211663 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.211664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.211674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.211736 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:35.212655 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.213175 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.214104 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.214305 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.214370 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.216359 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:35.216360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:35.216360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:35.216366 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:35.217828 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.218185 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.218186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.218187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.218240 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.218452 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.218453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.218453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.218609 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:35.218666 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.218898 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.218964 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260619 02:48:35.219209 31154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.210869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:43355 (local address 127.12.145.65:50021)
0619 02:48:35.211038 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.211079 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.211555 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.211798 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.211802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.212378 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:35.212565 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.212570 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.213257 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.213257 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.214017 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.214019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.214387 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.214387 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.214482 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.214941 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:35.214949 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:35.216273 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:35.217902 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:35.217907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:35.217909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:35.218107 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:35.218305 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:35.218305 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:35.218306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:35.218397 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:35.218669 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:35.218674 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:35.218793 (+ 119us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.218872 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.218985 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260619 02:48:35.219779 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 31023
I20260619 02:48:35.219774 31152 heartbeater.cc:347] Connected to a master server at 127.12.145.126:43355
I20260619 02:48:35.219890 31152 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:35.219902 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:48:35.220069 31152 heartbeater.cc:511] Master 127.12.145.126:43355 requested a full tablet report, sending...
I20260619 02:48:35.220122 12869 external_mini_cluster.cc:1428] Setting key 9babc6af12a1d5d30939211780522d66
I20260619 02:48:35.220600 30961 ts_manager.cc:194] Registered new tserver with Master: 14d0e133732a4f748f63f09d1d4a3d4b (127.12.145.65:37395)
I20260619 02:48:35.221212 30961 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:50021
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:48:35.245365 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43355
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:35.324925 31157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:35.325168 31157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:35.325217 31157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:35.326363 31157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:35.326434 31157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:35.326478 31157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:48:35.328022 31157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:35.328296 31157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:35.328577 31157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:35.333660 31162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:35.333666 31165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:35.333724 31157 server_base.cc:1034] running on GCE node
W20260619 02:48:35.333676 31163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:35.334095 31157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:35.334354 31157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:35.335511 31157 hybrid_clock.cc:648] HybridClock initialized: now 1781837315335509 us; error 35 us; skew 500 ppm
Jun 19 02:48:35 dist-test-slave-fbl4 krb5kdc[30916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:35.337847 31157 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:48:35.338321 31157 webserver.cc:460] Webserver started at http://127.12.145.66:37263/ using document root <none> and password file <none>
I20260619 02:48:35.338613 31157 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:35.338691 31157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:35.338829 31157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:35.339851 31157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "0e9f3050719140b8857245994fb17c7d"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "dce2ee17d83ef5c5f9f77232d0fd1f47"
server_key_iv: "20459d01c9943d8b6c8a0f82e35a8bd5"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.340216 31157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "0e9f3050719140b8857245994fb17c7d"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "dce2ee17d83ef5c5f9f77232d0fd1f47"
server_key_iv: "20459d01c9943d8b6c8a0f82e35a8bd5"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.341563 31157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:35.342239 31172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.342413 31157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:35.342509 31157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "0e9f3050719140b8857245994fb17c7d"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "dce2ee17d83ef5c5f9f77232d0fd1f47"
server_key_iv: "20459d01c9943d8b6c8a0f82e35a8bd5"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.342621 31157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:35.350757 31157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:35.352468 31157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:35.352625 31157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:35.352844 31157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:35.353157 31157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:35.353219 31157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.353259 31157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:35.353287 31157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.359122 31157 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:36071
I20260619 02:48:35.359169 31285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:36071 every 8 connection(s)
I20260619 02:48:35.359463 31157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:48:35.359740 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 31157
I20260619 02:48:35.359845 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:48:35.360069 12869 external_mini_cluster.cc:1428] Setting key f6c8c43df214dfefd3dd5818fad7356d
Jun 19 02:48:35 dist-test-slave-fbl4 krb5kdc[30916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
I20260619 02:48:35.369902 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.360149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:38871 (local address 127.12.145.126:43355)
0619 02:48:35.360252 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.360254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.360622 (+ 368us) server_negotiation.cc:407] Connection header received
0619 02:48:35.360967 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.360968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.360981 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.361050 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:35.361904 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.362455 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.363468 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.363783 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.363859 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.366197 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:35.366198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:35.366199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:35.366205 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:35.368415 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.368920 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.368921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.368921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.368972 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.369243 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.369243 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.369244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.369341 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:35.369390 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.369732 (+ 342us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.369796 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 02:48:35.370044 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.360123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:43355 (local address 127.12.145.66:38871)
0619 02:48:35.360287 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.360332 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.360877 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.361099 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.361102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.361632 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:35.361811 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.361815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.362533 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.362533 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.363378 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.363380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.363868 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.363868 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.363966 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.364433 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:35.364440 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:35.366090 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:35.368511 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:35.368519 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:35.368521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:35.368836 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:35.369038 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:35.369039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:35.369039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:35.369178 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:35.369408 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:35.369413 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:35.369576 (+ 163us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.369699 (+ 123us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.369850 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
I20260619 02:48:35.370488 31286 heartbeater.cc:347] Connected to a master server at 127.12.145.126:43355
I20260619 02:48:35.370616 31286 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:35.370771 31286 heartbeater.cc:511] Master 127.12.145.126:43355 requested a full tablet report, sending...
I20260619 02:48:35.371145 30961 ts_manager.cc:194] Registered new tserver with Master: 0e9f3050719140b8857245994fb17c7d (127.12.145.66:36071)
I20260619 02:48:35.371538 30961 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:38871
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:48:35.385753 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43355
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:35.465560 31291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:35.465762 31291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:35.465785 31291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:35.466886 31291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:35.466920 31291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:35.466946 31291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:48:35.468289 31291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:43355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:35.468468 31291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:35.468636 31291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:35.473608 31296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:35.473713 31291 server_base.cc:1034] running on GCE node
W20260619 02:48:35.473542 31297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:35.473532 31299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:35.474014 31291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:35.474218 31291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:35.475397 31291 hybrid_clock.cc:648] HybridClock initialized: now 1781837315475389 us; error 34 us; skew 500 ppm
Jun 19 02:48:35 dist-test-slave-fbl4 krb5kdc[30916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:35.477778 31291 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:48:35.478240 31291 webserver.cc:460] Webserver started at http://127.12.145.67:41037/ using document root <none> and password file <none>
I20260619 02:48:35.478468 31291 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:35.478534 31291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:35.478713 31291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:35.479789 31291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "bb2903652f594c8798f5347ecbca7331"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "ec0a3ca14dd2f4e18a47c992b8c84c14"
server_key_iv: "e27500abe74e943c095e3d057336755c"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.480154 31291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "bb2903652f594c8798f5347ecbca7331"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "ec0a3ca14dd2f4e18a47c992b8c84c14"
server_key_iv: "e27500abe74e943c095e3d057336755c"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.481478 31291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:35.482187 31306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.482355 31291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:35.482460 31291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "bb2903652f594c8798f5347ecbca7331"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "ec0a3ca14dd2f4e18a47c992b8c84c14"
server_key_iv: "e27500abe74e943c095e3d057336755c"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.482543 31291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:35.492707 31291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:35.494778 31291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:35.494969 31291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:35.495218 31291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:35.495537 31291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:35.495592 31291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.495631 31291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:35.495661 31291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.501698 31291 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:35111
I20260619 02:48:35.501749 31419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:35111 every 8 connection(s)
I20260619 02:48:35.502080 31291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
Jun 19 02:48:35 dist-test-slave-fbl4 krb5kdc[30916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:35.510151 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 31291
I20260619 02:48:35.510265 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:48:35.510525 12869 external_mini_cluster.cc:1428] Setting key c620168b67f8decba06de3b892e2663e
I20260619 02:48:35.511508 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.502785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:37773 (local address 127.12.145.126:43355)
0619 02:48:35.502828 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.502830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.503067 (+ 237us) server_negotiation.cc:407] Connection header received
0619 02:48:35.503666 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.503667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.503680 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.503747 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:35.504686 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.505189 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.506215 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.506410 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.506486 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.508721 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:35.508722 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:35.508722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:35.508729 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:35.509909 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.510425 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.510426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.510426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.510480 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.510793 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.510794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.510795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.510951 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:35.511016 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.511334 (+ 318us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.511416 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:48:35.511864 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.502781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:43355 (local address 127.12.145.67:37773)
0619 02:48:35.502951 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.502984 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.503544 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.503833 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.503842 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.504396 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:35.504583 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.504588 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.505284 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.505285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.506112 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.506115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.506491 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.506493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.506658 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.507172 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:35.507180 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:35.508630 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:35.509999 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:35.510006 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:35.510009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:35.510343 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:35.510570 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:35.510571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:35.510571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:35.510720 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:35.511021 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:35.511027 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:35.511193 (+ 166us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.511313 (+ 120us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.511474 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":86,"threads_started":1}
I20260619 02:48:35.512291 31420 heartbeater.cc:347] Connected to a master server at 127.12.145.126:43355
I20260619 02:48:35.512380 31420 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:35.512521 31420 heartbeater.cc:511] Master 127.12.145.126:43355 requested a full tablet report, sending...
I20260619 02:48:35.512861 30961 ts_manager.cc:194] Registered new tserver with Master: bb2903652f594c8798f5347ecbca7331 (127.12.145.67:35111)
I20260619 02:48:35.513198 30961 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:37773
I20260619 02:48:35.522439 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:48:35.530479 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.523832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39920 (local address 127.12.145.126:43355)
0619 02:48:35.523896 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.523898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.524035 (+ 137us) server_negotiation.cc:407] Connection header received
0619 02:48:35.524134 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.524135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.524143 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.524187 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:35.524709 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.525169 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.525954 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.526137 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.526190 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.527636 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:35.527637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:35.527637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:35.527643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:35.528980 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.529416 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.529417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.529418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.529466 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:35.529736 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:35.529737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:35.529737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:35.529904 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:35.530013 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.530234 (+ 221us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.530359 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:48:35.532127 30961 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:48:35.533679 30961 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:48:35.539716 31433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.536260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35350 (local address 127.12.145.67:35111)
0619 02:48:35.536458 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.536463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.536474 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:48:35.536516 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.536518 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.536535 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.536622 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:35.536881 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.537634 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.538749 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.539292 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.539378 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.539438 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.539592 (+ 154us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.539632 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260619 02:48:35.539706 31428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.535809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:35111 (local address 127.0.0.1:35350)
0619 02:48:35.535913 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.535950 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.536014 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.536637 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.536642 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.536644 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:35.536785 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.536788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.537738 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.537739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.538653 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.538656 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.539389 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.539390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.539472 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.539485 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.539575 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.539631 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":1,"thread_start_us":64,"threads_started":1}
I20260619 02:48:35.540464 31430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.535813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:37395 (local address 127.0.0.1:38580)
0619 02:48:35.536285 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.536295 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.536352 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.536662 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.536663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.536666 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:35.536800 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.536802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.538111 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.538112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.539372 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.539374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.540237 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.540238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.540303 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.540307 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.540357 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.540385 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":160,"thread_start_us":57,"threads_started":1}
I20260619 02:48:35.540611 31431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.536070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54872 (local address 127.12.145.66:36071)
0619 02:48:35.536247 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.536252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.536537 (+ 285us) server_negotiation.cc:407] Connection header received
0619 02:48:35.536580 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.536583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.536605 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.536684 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:35.536934 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.537993 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.539449 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.540148 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.540197 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.540249 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.540470 (+ 221us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.540518 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260619 02:48:35.540549 31429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.535820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:36071 (local address 127.0.0.1:54872)
0619 02:48:35.536453 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.536462 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.536508 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.536795 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.536796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.536798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:35.536847 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.536848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.538111 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.538112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.539344 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.539347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.540314 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.540315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.540385 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.540389 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.540440 (+ 51us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.540480 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":33,"thread_start_us":54,"threads_started":1}
I20260619 02:48:35.540705 31354 tablet_service.cc:1467] Processing CreateTablet for tablet 1fd8acee76594121a22f1b507a2b2cdc (DEFAULT_TABLE table=test-table [id=561723ec4bef4080a2ba30dba321ca7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:35.541100 31354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fd8acee76594121a22f1b507a2b2cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:35.541363 31220 tablet_service.cc:1467] Processing CreateTablet for tablet 1fd8acee76594121a22f1b507a2b2cdc (DEFAULT_TABLE table=test-table [id=561723ec4bef4080a2ba30dba321ca7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:35.541671 31220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fd8acee76594121a22f1b507a2b2cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:35.543598 31434 tablet_bootstrap.cc:492] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Bootstrap starting.
I20260619 02:48:35.543807 31432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.536104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.12.145.65:37395)
0619 02:48:35.536301 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.536306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.536344 (+ 38us) server_negotiation.cc:407] Connection header received
0619 02:48:35.536446 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.536448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.536463 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.536569 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:35.536884 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.537988 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.539452 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.540158 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.540224 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.543653 (+ 3429us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.543682 (+ 29us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.543731 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260619 02:48:35.544306 31434 tablet_bootstrap.cc:654] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:35.544302 31435 tablet_bootstrap.cc:492] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Bootstrap starting.
I20260619 02:48:35.544466 31086 tablet_service.cc:1467] Processing CreateTablet for tablet 1fd8acee76594121a22f1b507a2b2cdc (DEFAULT_TABLE table=test-table [id=561723ec4bef4080a2ba30dba321ca7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:35.544778 31086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fd8acee76594121a22f1b507a2b2cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:35.544891 31434 log.cc:824] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:35.544975 31435 tablet_bootstrap.cc:654] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:35.545596 31435 log.cc:824] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:35.545794 31434 tablet_bootstrap.cc:492] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: No bootstrap required, opened a new log
I20260619 02:48:35.545848 31434 ts_tablet_manager.cc:1397] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:35.546350 31435 tablet_bootstrap.cc:492] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: No bootstrap required, opened a new log
I20260619 02:48:35.546406 31435 ts_tablet_manager.cc:1397] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:35.547857 31434 raft_consensus.cc:348] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.548041 31434 raft_consensus.cc:374] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:35.548074 31434 raft_consensus.cc:729] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb2903652f594c8798f5347ecbca7331, State: Initialized, Role: FOLLOWER
I20260619 02:48:35.548192 31434 consensus_queue.cc:260] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.548303 31435 raft_consensus.cc:348] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.548462 31434 ts_tablet_manager.cc:1428] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:48:35.548468 31435 raft_consensus.cc:374] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:35.548483 31420 heartbeater.cc:503] Master 127.12.145.126:43355 was elected leader, sending a full tablet report...
I20260619 02:48:35.548503 31435 raft_consensus.cc:729] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e9f3050719140b8857245994fb17c7d, State: Initialized, Role: FOLLOWER
I20260619 02:48:35.548606 31435 consensus_queue.cc:260] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.548903 31435 ts_tablet_manager.cc:1428] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:48:35.549026 31286 heartbeater.cc:503] Master 127.12.145.126:43355 was elected leader, sending a full tablet report...
I20260619 02:48:35.549072 31438 tablet_bootstrap.cc:492] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: Bootstrap starting.
I20260619 02:48:35.549721 31438 tablet_bootstrap.cc:654] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:35.550232 31438 log.cc:824] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:35.550942 31438 tablet_bootstrap.cc:492] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: No bootstrap required, opened a new log
I20260619 02:48:35.551007 31438 ts_tablet_manager.cc:1397] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:35.552369 31438 raft_consensus.cc:348] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.552495 31438 raft_consensus.cc:374] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:35.552516 31438 raft_consensus.cc:729] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14d0e133732a4f748f63f09d1d4a3d4b, State: Initialized, Role: FOLLOWER
I20260619 02:48:35.552628 31438 consensus_queue.cc:260] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.552858 31438 ts_tablet_manager.cc:1428] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:35.552917 31152 heartbeater.cc:503] Master 127.12.145.126:43355 was elected leader, sending a full tablet report...
W20260619 02:48:35.610039 31287 tablet.cc:2369] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:48:35.710729 31153 tablet.cc:2369] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:48:35.745370 31442 raft_consensus.cc:482] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:35.745525 31442 raft_consensus.cc:504] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.745959 31442 leader_election.cc:288] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb2903652f594c8798f5347ecbca7331 (127.12.145.67:35111), 0e9f3050719140b8857245994fb17c7d (127.12.145.66:36071)
I20260619 02:48:35.750164 31433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.746274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:32819 (local address 127.12.145.67:35111)
0619 02:48:35.746324 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.746327 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.746434 (+ 107us) server_negotiation.cc:407] Connection header received
0619 02:48:35.746510 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.746511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.746521 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.746641 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:35.746819 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.747541 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.749156 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.749750 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.749831 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.749840 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.750056 (+ 216us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.750095 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:48:35.750217 31431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.746286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:38901 (local address 127.12.145.66:36071)
0619 02:48:35.746349 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.746351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.746471 (+ 120us) server_negotiation.cc:407] Connection header received
0619 02:48:35.746528 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.746529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.746540 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.746643 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:35.746821 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.747541 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.749156 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.749751 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.749831 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.749840 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.750056 (+ 216us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.750144 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260619 02:48:35.750236 31444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.746173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:35111 (local address 127.12.145.65:32819)
0619 02:48:35.746351 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.746363 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.746427 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.746644 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.746645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.746647 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:35.746729 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.746732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.747642 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.747644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.749053 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.749057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.749866 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.749866 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.749957 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.749965 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.750032 (+ 67us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.750097 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":84,"thread_start_us":88,"threads_started":1}
I20260619 02:48:35.750429 31443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.746178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:36071 (local address 127.12.145.65:38901)
0619 02:48:35.746384 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.746393 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:35.746464 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:35.746687 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:35.746688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:35.746689 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:35.746750 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.746751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.747643 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.747644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.749053 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:35.749057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.749864 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.749866 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:35.749957 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.749963 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 02:48:35.750032 (+ 69us) client_negotiation.cc:240] Negotiation successful
0619 02:48:35.750087 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":54,"thread_start_us":88,"threads_started":1}
I20260619 02:48:35.750686 31374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fd8acee76594121a22f1b507a2b2cdc" candidate_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb2903652f594c8798f5347ecbca7331" is_pre_election: true
I20260619 02:48:35.750864 31374 raft_consensus.cc:2454] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14d0e133732a4f748f63f09d1d4a3d4b in term 0.
I20260619 02:48:35.751015 31240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fd8acee76594121a22f1b507a2b2cdc" candidate_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9f3050719140b8857245994fb17c7d" is_pre_election: true
I20260619 02:48:35.751102 31042 leader_election.cc:302] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14d0e133732a4f748f63f09d1d4a3d4b, bb2903652f594c8798f5347ecbca7331; no voters:
I20260619 02:48:35.751199 31240 raft_consensus.cc:2454] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14d0e133732a4f748f63f09d1d4a3d4b in term 0.
I20260619 02:48:35.751225 31442 raft_consensus.cc:2781] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:48:35.751273 31442 raft_consensus.cc:482] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:48:35.751300 31442 raft_consensus.cc:3037] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:35.751994 31442 raft_consensus.cc:504] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.752137 31442 leader_election.cc:288] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [CANDIDATE]: Term 1 election: Requested vote from peers bb2903652f594c8798f5347ecbca7331 (127.12.145.67:35111), 0e9f3050719140b8857245994fb17c7d (127.12.145.66:36071)
I20260619 02:48:35.752295 31374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fd8acee76594121a22f1b507a2b2cdc" candidate_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb2903652f594c8798f5347ecbca7331"
I20260619 02:48:35.752372 31374 raft_consensus.cc:3037] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:35.752450 31240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fd8acee76594121a22f1b507a2b2cdc" candidate_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e9f3050719140b8857245994fb17c7d"
W20260619 02:48:35.752540 31421 tablet.cc:2369] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:48:35.752558 31240 raft_consensus.cc:3037] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:35.753176 31374 raft_consensus.cc:2454] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14d0e133732a4f748f63f09d1d4a3d4b in term 1.
I20260619 02:48:35.753337 31042 leader_election.cc:302] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14d0e133732a4f748f63f09d1d4a3d4b, bb2903652f594c8798f5347ecbca7331; no voters:
I20260619 02:48:35.753391 31240 raft_consensus.cc:2454] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14d0e133732a4f748f63f09d1d4a3d4b in term 1.
I20260619 02:48:35.753455 31442 raft_consensus.cc:2781] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:35.753654 31442 raft_consensus.cc:686] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 1 LEADER]: Becoming Leader. State: Replica: 14d0e133732a4f748f63f09d1d4a3d4b, State: Running, Role: LEADER
I20260619 02:48:35.753759 31442 consensus_queue.cc:237] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } }
I20260619 02:48:35.754583 30961 catalog_manager.cc:5495] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 14d0e133732a4f748f63f09d1d4a3d4b (127.12.145.65). New cstate: current_term: 1 leader_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14d0e133732a4f748f63f09d1d4a3d4b" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 37395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 } health_report { overall_health: UNKNOWN } } }
I20260619 02:48:35.768565 31432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.766319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38586 (local address 127.12.145.65:37395)
0619 02:48:35.766377 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.766379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.766386 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:48:35.766451 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.766452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.766468 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.766525 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:48:35.766713 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.767164 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.767848 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.768024 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.768075 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.768213 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:48:35.768296 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:48:35.768364 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.768427 (+ 63us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.768457 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 02:48:35.770396 31240 raft_consensus.cc:1261] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 1 FOLLOWER]: Refusing update from remote peer 14d0e133732a4f748f63f09d1d4a3d4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:35.770396 31374 raft_consensus.cc:1261] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 1 FOLLOWER]: Refusing update from remote peer 14d0e133732a4f748f63f09d1d4a3d4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:35.770778 31442 consensus_queue.cc:1035] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e9f3050719140b8857245994fb17c7d" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 36071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:35.770910 31445 consensus_queue.cc:1035] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb2903652f594c8798f5347ecbca7331" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 35111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:35.773597 31449 mvcc.cc:205] Tried to move back new op lower bound from 7298405645392588800 to 7298405645328019456. Current Snapshot: MvccSnapshot[applied={T|T < 7298405645392588800}]
I20260619 02:48:35.773936 31450 mvcc.cc:205] Tried to move back new op lower bound from 7298405645392588800 to 7298405645328019456. Current Snapshot: MvccSnapshot[applied={T|T < 7298405645392588800}]
I20260619 02:48:35.774279 31448 mvcc.cc:205] Tried to move back new op lower bound from 7298405645392588800 to 7298405645328019456. Current Snapshot: MvccSnapshot[applied={T|T < 7298405645392588800 or (T in {7298405645392588800})}]
I20260619 02:48:35.776055 30960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:35.776161 30960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:35.776893 30960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7fc8eaad2b142aaa00584821651e0ef: Sending DeleteTablet for 3 replicas of tablet 1fd8acee76594121a22f1b507a2b2cdc
I20260619 02:48:35.777237 31086 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fd8acee76594121a22f1b507a2b2cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:35 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:38580
I20260619 02:48:35.777279 31220 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fd8acee76594121a22f1b507a2b2cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:35 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:54872
I20260619 02:48:35.777246 31354 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fd8acee76594121a22f1b507a2b2cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:35 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:35350
I20260619 02:48:35.777493 31459 tablet_replica.cc:330] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: stopping tablet replica
I20260619 02:48:35.777572 31458 tablet_replica.cc:330] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: stopping tablet replica
I20260619 02:48:35.777626 31460 tablet_replica.cc:330] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b: stopping tablet replica
I20260619 02:48:35.777697 31458 raft_consensus.cc:2229] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:35.777748 31460 raft_consensus.cc:2229] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:48:35.777796 31458 raft_consensus.cc:2258] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:35.777834 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 31023
I20260619 02:48:35.777854 31460 raft_consensus.cc:2258] T 1fd8acee76594121a22f1b507a2b2cdc P 14d0e133732a4f748f63f09d1d4a3d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:35.777977 31459 raft_consensus.cc:2229] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:35.778059 31459 raft_consensus.cc:2258] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:35.779347 31458 ts_tablet_manager.cc:1905] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:35.779461 31459 ts_tablet_manager.cc:1905] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:35.781220 31458 ts_tablet_manager.cc:1918] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:35.781220 31459 ts_tablet_manager.cc:1918] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:35.781296 31458 log.cc:1196] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/1fd8acee76594121a22f1b507a2b2cdc
I20260619 02:48:35.781296 31459 log.cc:1196] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/1fd8acee76594121a22f1b507a2b2cdc
I20260619 02:48:35.781574 31459 ts_tablet_manager.cc:1939] T 1fd8acee76594121a22f1b507a2b2cdc P bb2903652f594c8798f5347ecbca7331: Deleting consensus metadata
I20260619 02:48:35.781574 31458 ts_tablet_manager.cc:1939] T 1fd8acee76594121a22f1b507a2b2cdc P 0e9f3050719140b8857245994fb17c7d: Deleting consensus metadata
I20260619 02:48:35.782033 30945 catalog_manager.cc:4841] TS 0e9f3050719140b8857245994fb17c7d (127.12.145.66:36071): tablet 1fd8acee76594121a22f1b507a2b2cdc (table test-table [id=561723ec4bef4080a2ba30dba321ca7f]) successfully deleted
I20260619 02:48:35.782059 30948 catalog_manager.cc:4841] TS bb2903652f594c8798f5347ecbca7331 (127.12.145.67:35111): tablet 1fd8acee76594121a22f1b507a2b2cdc (table test-table [id=561723ec4bef4080a2ba30dba321ca7f]) successfully deleted
W20260619 02:48:35.784060 30947 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:37395 (error 108)
I20260619 02:48:35.784181 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 31157
I20260619 02:48:35.784850 31430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.784384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:37395 (local address 127.0.0.1:38594)
0619 02:48:35.784775 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:35.784812 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:37395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371}
W20260619 02:48:35.785089 30947 catalog_manager.cc:4584] TS 14d0e133732a4f748f63f09d1d4a3d4b (127.12.145.65:37395): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1fd8acee76594121a22f1b507a2b2cdc: Network error: Client connection negotiation failed: client connection to 127.12.145.65:37395: connect: Connection refused (error 111)
I20260619 02:48:35.789529 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 31291
I20260619 02:48:35.793789 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 30929
2026-06-19T02:48:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2058 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-06-19T02:48:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:35Z Disabled control of system clock
I20260619 02:48:35.820768 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45449
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:37941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:45449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 02:48:35.900223 31465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:35.900432 31465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:35.900452 31465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:35.901490 31465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:35.901523 31465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:35.901535 31465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:35.901547 31465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:35.901559 31465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:35.902865 31465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:45449
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:35.903048 31465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:35.903266 31465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:35.907943 31471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:35.907934 31473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:35.908077 31465 server_base.cc:1034] running on GCE node
W20260619 02:48:35.907975 31470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:35.908377 31465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:35.908659 31465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:35.909806 31465 hybrid_clock.cc:648] HybridClock initialized: now 1781837315909796 us; error 33 us; skew 500 ppm
I20260619 02:48:35.911150 31465 webserver.cc:460] Webserver started at http://127.12.145.126:41063/ using document root <none> and password file <none>
I20260619 02:48:35.911396 31465 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:35.911450 31465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:35.911626 31465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:35.912675 31465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "408a0a0cfbff4aca84df542e3a04b730"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "c2c8de97a24b4ed03deabb15abd7594c"
server_key_iv: "525cf73904b9545424a65f7bc8b032ba"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.913046 31465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "408a0a0cfbff4aca84df542e3a04b730"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "c2c8de97a24b4ed03deabb15abd7594c"
server_key_iv: "525cf73904b9545424a65f7bc8b032ba"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.914305 31465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:48:35.915061 31479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.915252 31465 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:35.915350 31465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "408a0a0cfbff4aca84df542e3a04b730"
format_stamp: "Formatted at 2026-06-19 02:48:35 on dist-test-slave-fbl4"
server_key: "c2c8de97a24b4ed03deabb15abd7594c"
server_key_iv: "525cf73904b9545424a65f7bc8b032ba"
server_key_version: "encryptionkey@0"
I20260619 02:48:35.915434 31465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:35.927263 31465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:35.927560 31465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:35.927711 31465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:35.931553 31465 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:45449
I20260619 02:48:35.931584 31531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:45449 every 8 connection(s)
I20260619 02:48:35.931923 31465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:35.932914 31532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:35.934849 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 31465
I20260619 02:48:35.934942 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:35.935144 12869 external_mini_cluster.cc:1428] Setting key e8e2f4bd886164fa17c0913f81fd7366
I20260619 02:48:35.935477 31532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730: Bootstrap starting.
I20260619 02:48:35.936094 31532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:35.936394 31532 log.cc:824] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:35.937136 31532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730: No bootstrap required, opened a new log
I20260619 02:48:35.939293 31532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "408a0a0cfbff4aca84df542e3a04b730" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45449 } }
I20260619 02:48:35.939487 31532 raft_consensus.cc:374] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:35.939529 31532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 408a0a0cfbff4aca84df542e3a04b730, State: Initialized, Role: FOLLOWER
I20260619 02:48:35.939689 31532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "408a0a0cfbff4aca84df542e3a04b730" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45449 } }
I20260619 02:48:35.939756 31532 raft_consensus.cc:388] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:35.939777 31532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:35.939834 31532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:35.940533 31532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "408a0a0cfbff4aca84df542e3a04b730" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45449 } }
I20260619 02:48:35.940637 31532 leader_election.cc:302] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 408a0a0cfbff4aca84df542e3a04b730; no voters:
I20260619 02:48:35.940801 31532 leader_election.cc:288] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:35.940824 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:35.935654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58792 (local address 127.12.145.126:45449)
0619 02:48:35.935852 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:35.935861 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:35.935896 (+ 35us) server_negotiation.cc:407] Connection header received
0619 02:48:35.936346 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:35.936354 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:35.936416 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:35.936576 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:35.936817 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.937744 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.938906 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:35.939288 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:35.939376 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:35.940096 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:35.940100 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:35.940100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:35.940301 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:35.940347 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:35.940360 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:35.940435 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:35.940496 (+ 61us) server_negotiation.cc:299] Negotiation successful
0619 02:48:35.940575 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260619 02:48:35.940861 31537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:35.940996 31537 raft_consensus.cc:686] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [term 1 LEADER]: Becoming Leader. State: Replica: 408a0a0cfbff4aca84df542e3a04b730, State: Running, Role: LEADER
I20260619 02:48:35.941043 31532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:35.941074 31537 consensus_queue.cc:237] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "408a0a0cfbff4aca84df542e3a04b730" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45449 } }
I20260619 02:48:35.941395 31537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "408a0a0cfbff4aca84df542e3a04b730" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "408a0a0cfbff4aca84df542e3a04b730" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45449 } } }
I20260619 02:48:35.941421 31538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 408a0a0cfbff4aca84df542e3a04b730. Latest consensus state: current_term: 1 leader_uuid: "408a0a0cfbff4aca84df542e3a04b730" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "408a0a0cfbff4aca84df542e3a04b730" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45449 } } }
I20260619 02:48:35.941470 31537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:35.941502 31538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:35.941689 31544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:35.942193 31544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:35.943707 31544 catalog_manager.cc:1347] Generated new cluster ID: 5f49b7f6c5594fb3a8ef1a9efbff913a
I20260619 02:48:35.943773 31544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:35.950294 31544 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:35.950956 31544 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:35.957206 31544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730: Generated new TSK 0
I20260619 02:48:35.957369 31544 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:35.965359 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:45449
--builtin_ntp_servers=127.12.145.84:37941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 02:48:36.047010 31556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:36.047212 31556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:36.047235 31556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:36.048381 31556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:36.048424 31556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:36.048449 31556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:48:36.049870 31556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:45449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:36.050107 31556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:36.050424 31556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:36.056253 31562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:36.056308 31564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:36.056371 31561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:36.056808 31556 server_base.cc:1034] running on GCE node
I20260619 02:48:36.057009 31556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:36.057272 31556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:36.058429 31556 hybrid_clock.cc:648] HybridClock initialized: now 1781837316058403 us; error 46 us; skew 500 ppm
I20260619 02:48:36.059793 31556 webserver.cc:460] Webserver started at http://127.12.145.65:46361/ using document root <none> and password file <none>
I20260619 02:48:36.060022 31556 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:36.060109 31556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:36.060250 31556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:36.061313 31556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "9c1b0555393a40c7a170cbc93fd304b2"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "2f7d7ca28faa68c063483b269846e750"
server_key_iv: "6a4133d765106bb4a482247b4598b44e"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.061679 31556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "9c1b0555393a40c7a170cbc93fd304b2"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "2f7d7ca28faa68c063483b269846e750"
server_key_iv: "6a4133d765106bb4a482247b4598b44e"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.063093 31556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260619 02:48:36.063865 31570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.064092 31556 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:36.064193 31556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "9c1b0555393a40c7a170cbc93fd304b2"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "2f7d7ca28faa68c063483b269846e750"
server_key_iv: "6a4133d765106bb4a482247b4598b44e"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.064261 31556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:36.100136 31556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:36.100476 31556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:36.100591 31556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:36.100786 31556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:36.101135 31556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:36.101171 31556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.101194 31556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:36.101243 31556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.107209 31556 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:45893
I20260619 02:48:36.107250 31683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:45893 every 8 connection(s)
I20260619 02:48:36.107594 31556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:48:36.110654 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 31556
I20260619 02:48:36.110765 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:48:36.110951 12869 external_mini_cluster.cc:1428] Setting key 05575688a58042ea4962110cb26ccd7a
I20260619 02:48:36.112004 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:45449
--builtin_ntp_servers=127.12.145.84:37941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 02:48:36.113268 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.108349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:49509 (local address 127.12.145.126:45449)
0619 02:48:36.108434 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.108436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.108642 (+ 206us) server_negotiation.cc:407] Connection header received
0619 02:48:36.109147 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.109148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.109157 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.109210 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:36.109834 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.110319 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.111589 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.111868 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.111939 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.112908 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:36.112910 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:36.112910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:36.112915 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:36.112931 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:36.112936 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:36.113010 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.113125 (+ 115us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.113152 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 02:48:36.113457 31686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.108312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:45449 (local address 127.12.145.65:49509)
0619 02:48:36.108522 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.108557 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.109059 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.109263 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.109266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.109274 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:36.109767 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.109771 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.110399 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.110400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.111479 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.111482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.111955 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.111956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.112138 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.112741 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:36.112742 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:36.112794 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:36.112822 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:36.113044 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:36.113049 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:36.113051 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.113113 (+ 62us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.113214 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
I20260619 02:48:36.113996 31684 heartbeater.cc:347] Connected to a master server at 127.12.145.126:45449
I20260619 02:48:36.114090 31684 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:36.114264 31684 heartbeater.cc:511] Master 127.12.145.126:45449 requested a full tablet report, sending...
I20260619 02:48:36.114845 31496 ts_manager.cc:194] Registered new tserver with Master: 9c1b0555393a40c7a170cbc93fd304b2 (127.12.145.65:45893)
I20260619 02:48:36.115782 31496 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.65:49509
W20260619 02:48:36.191653 31687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:36.191839 31687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:36.191860 31687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:36.192906 31687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:36.192936 31687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:36.192960 31687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:48:36.194218 31687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:45449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:36.194387 31687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:36.194631 31687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:36.199316 31692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:36.199328 31695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:36.199323 31693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:36.199517 31687 server_base.cc:1034] running on GCE node
I20260619 02:48:36.199747 31687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:36.199987 31687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:36.201148 31687 hybrid_clock.cc:648] HybridClock initialized: now 1781837316201131 us; error 38 us; skew 500 ppm
I20260619 02:48:36.202306 31687 webserver.cc:460] Webserver started at http://127.12.145.66:40597/ using document root <none> and password file <none>
I20260619 02:48:36.202607 31687 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:36.202687 31687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:36.202831 31687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:36.203977 31687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "f2b84c7650844e51aa44d1dc1aa882cb"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "261bdef3cafd852b18f429505f3724a1"
server_key_iv: "40b5bcd7e39046e7f0f0e95e1852f859"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.204334 31687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "f2b84c7650844e51aa44d1dc1aa882cb"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "261bdef3cafd852b18f429505f3724a1"
server_key_iv: "40b5bcd7e39046e7f0f0e95e1852f859"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.205675 31687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:36.206383 31701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.206561 31687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:36.206657 31687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "f2b84c7650844e51aa44d1dc1aa882cb"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "261bdef3cafd852b18f429505f3724a1"
server_key_iv: "40b5bcd7e39046e7f0f0e95e1852f859"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.206745 31687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:36.229647 31687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:36.229983 31687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:36.230144 31687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:36.230379 31687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:36.230789 31687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:36.230849 31687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.230885 31687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:36.230911 31687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.236723 31687 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:44591
I20260619 02:48:36.236761 31814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:44591 every 8 connection(s)
I20260619 02:48:36.237107 31687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:48:36.237566 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 31687
I20260619 02:48:36.237676 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:48:36.237921 12869 external_mini_cluster.cc:1428] Setting key 0c31f4d9e0d7af0132de037a751d0e8b
I20260619 02:48:36.238951 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:45449
--builtin_ntp_servers=127.12.145.84:37941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 02:48:36.242803 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.237871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:57021 (local address 127.12.145.126:45449)
0619 02:48:36.237913 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.237915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.238240 (+ 325us) server_negotiation.cc:407] Connection header received
0619 02:48:36.238867 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.238869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.238880 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.238927 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:36.239709 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.240212 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.241211 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.241501 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.241586 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.242501 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:36.242503 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:36.242503 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:36.242508 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:36.242523 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:36.242527 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:36.242617 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.242693 (+ 76us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.242719 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:48:36.243026 31817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.237887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:45449 (local address 127.12.145.66:57021)
0619 02:48:36.238090 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.238145 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.238748 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.238998 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.239003 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.239013 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:36.239566 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.239603 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.240309 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.240310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.241115 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.241117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.241600 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.241601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.241760 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.242353 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:36.242354 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:36.242384 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:36.242407 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:36.242620 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:36.242626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:36.242629 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.242696 (+ 67us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.242797 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260619 02:48:36.243592 31815 heartbeater.cc:347] Connected to a master server at 127.12.145.126:45449
I20260619 02:48:36.243687 31815 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:36.243911 31815 heartbeater.cc:511] Master 127.12.145.126:45449 requested a full tablet report, sending...
I20260619 02:48:36.244331 31496 ts_manager.cc:194] Registered new tserver with Master: f2b84c7650844e51aa44d1dc1aa882cb (127.12.145.66:44591)
I20260619 02:48:36.244874 31496 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.66:57021
W20260619 02:48:36.321302 31818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:36.321511 31818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:36.321532 31818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:36.322698 31818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:36.322736 31818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:36.322765 31818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:48:36.324138 31818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:45449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:36.324331 31818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:36.324589 31818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:36.329523 31826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:36.329531 31823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:36.329597 31818 server_base.cc:1034] running on GCE node
W20260619 02:48:36.329535 31824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:36.329914 31818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:36.330189 31818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:36.331350 31818 hybrid_clock.cc:648] HybridClock initialized: now 1781837316331339 us; error 39 us; skew 500 ppm
I20260619 02:48:36.332623 31818 webserver.cc:460] Webserver started at http://127.12.145.67:46505/ using document root <none> and password file <none>
I20260619 02:48:36.332872 31818 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:36.332945 31818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:36.333123 31818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:36.334179 31818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "5749851130cb481397f7cbb44b5a9c18"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "6226e2d681ea41d59a6f0b82c4b32580"
server_key_iv: "473e055a5197f741f698eff7664f229d"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.334584 31818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "5749851130cb481397f7cbb44b5a9c18"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "6226e2d681ea41d59a6f0b82c4b32580"
server_key_iv: "473e055a5197f741f698eff7664f229d"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.335860 31818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:36.336621 31832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.336804 31818 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:36.336900 31818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "5749851130cb481397f7cbb44b5a9c18"
format_stamp: "Formatted at 2026-06-19 02:48:36 on dist-test-slave-fbl4"
server_key: "6226e2d681ea41d59a6f0b82c4b32580"
server_key_iv: "473e055a5197f741f698eff7664f229d"
server_key_version: "encryptionkey@0"
I20260619 02:48:36.336982 31818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:36.351671 31818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:36.351960 31818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:36.352115 31818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:36.352331 31818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:36.352670 31818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:36.352725 31818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.352773 31818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:36.352804 31818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:36.358454 31818 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:33781
I20260619 02:48:36.358501 31945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:33781 every 8 connection(s)
I20260619 02:48:36.358872 31818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:48:36.363624 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.359575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:40089 (local address 127.12.145.126:45449)
0619 02:48:36.359640 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.359643 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.359888 (+ 245us) server_negotiation.cc:407] Connection header received
0619 02:48:36.360349 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.360350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.360360 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.360415 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:36.361041 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.361520 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.362421 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.362617 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.362666 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.363404 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:36.363405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:36.363405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:36.363409 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:36.363422 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:36.363426 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:36.363468 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.363546 (+ 78us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.363566 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260619 02:48:36.363859 31948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.359569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:45449 (local address 127.12.145.67:40089)
0619 02:48:36.359771 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.359804 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.360268 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.360467 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.360471 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.360479 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:36.360970 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.360974 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.361602 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.361603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.362352 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.362353 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.362689 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.362690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.362800 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.363279 (+ 479us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:36.363280 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:36.363307 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:36.363328 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:36.363481 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:36.363484 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:36.363486 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.363534 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.363613 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":85,"threads_started":1}
I20260619 02:48:36.364143 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 31818
I20260619 02:48:36.364274 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:48:36.364450 31946 heartbeater.cc:347] Connected to a master server at 127.12.145.126:45449
I20260619 02:48:36.364529 12869 external_mini_cluster.cc:1428] Setting key 480cc8fcabc06bffb04521a8ee990faa
I20260619 02:48:36.364542 31946 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:36.364742 31946 heartbeater.cc:511] Master 127.12.145.126:45449 requested a full tablet report, sending...
I20260619 02:48:36.365118 31496 ts_manager.cc:194] Registered new tserver with Master: 5749851130cb481397f7cbb44b5a9c18 (127.12.145.67:33781)
I20260619 02:48:36.365530 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:48:36.365693 31496 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.67:40089
I20260619 02:48:36.369854 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.367032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58796 (local address 127.12.145.126:45449)
0619 02:48:36.367078 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.367081 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.367170 (+ 89us) server_negotiation.cc:407] Connection header received
0619 02:48:36.367214 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.367215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.367222 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.367264 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:36.367394 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.367924 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.368708 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.368921 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.368973 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.369552 (+ 579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:36.369553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:36.369553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:36.369557 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:36.369568 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:36.369572 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:36.369648 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.369727 (+ 79us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.369755 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:48:36.371434 31496 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:48:36.373034 31496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:48:36.379740 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.375387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.12.145.67:33781)
0619 02:48:36.375932 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.375936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.375946 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:48:36.375984 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.375986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.376001 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.376127 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:36.376329 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.377467 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.378563 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.379314 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.379389 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.379480 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.379610 (+ 130us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.379654 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":79,"threads_started":1}
I20260619 02:48:36.379766 31954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.375289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:33781 (local address 127.0.0.1:47938)
0619 02:48:36.375647 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.375691 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.375757 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.376189 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.376189 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.376191 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:36.376241 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.376243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.377566 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.377568 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.378461 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.378464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.379407 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.379409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.379483 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.379496 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.379588 (+ 92us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.379643 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":2,"thread_start_us":77,"threads_started":1}
I20260619 02:48:36.379949 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.375629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41564 (local address 127.12.145.66:44591)
0619 02:48:36.375775 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.375779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.375886 (+ 107us) server_negotiation.cc:407] Connection header received
0619 02:48:36.375960 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.375978 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.375995 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.376069 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:36.376330 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.377467 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.378885 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.379399 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.379466 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.379568 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.379805 (+ 237us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.379855 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260619 02:48:36.379962 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.375445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59574 (local address 127.12.145.65:45893)
0619 02:48:36.375652 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.375658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.376186 (+ 528us) server_negotiation.cc:407] Connection header received
0619 02:48:36.376230 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.376232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.376247 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.376315 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:36.376501 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.377185 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.378629 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.379318 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.379389 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.379480 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.379823 (+ 343us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.379878 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":110,"threads_started":1}
I20260619 02:48:36.379988 31958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.375513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:44591 (local address 127.0.0.1:41564)
0619 02:48:36.375803 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.375813 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.375878 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.376160 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.376163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.376166 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:36.376241 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.376244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.377551 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.377552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.378799 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.378801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.379602 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.379603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.379659 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.379662 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.379707 (+ 45us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.379744 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":39,"thread_start_us":71,"threads_started":1}
I20260619 02:48:36.380142 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.375336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45893 (local address 127.0.0.1:59574)
0619 02:48:36.375648 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.375691 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.375757 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.376386 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.376386 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.376388 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:36.376422 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.376423 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.377272 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.377274 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.378529 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.378531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.379531 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.379532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.379618 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.379622 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.379672 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.379710 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":3,"thread_start_us":109,"threads_started":1}
I20260619 02:48:36.380653 31749 tablet_service.cc:1467] Processing CreateTablet for tablet d465562efd194b729b20c8a66c02fe6b (DEFAULT_TABLE table=test-table [id=8401f7ae44854d76b09d5f02bb7ed115]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:36.380810 31618 tablet_service.cc:1467] Processing CreateTablet for tablet d465562efd194b729b20c8a66c02fe6b (DEFAULT_TABLE table=test-table [id=8401f7ae44854d76b09d5f02bb7ed115]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:36.381044 31749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d465562efd194b729b20c8a66c02fe6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:36.381017 31880 tablet_service.cc:1467] Processing CreateTablet for tablet d465562efd194b729b20c8a66c02fe6b (DEFAULT_TABLE table=test-table [id=8401f7ae44854d76b09d5f02bb7ed115]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:36.381191 31618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d465562efd194b729b20c8a66c02fe6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:36.381318 31880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d465562efd194b729b20c8a66c02fe6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:36.383864 31960 tablet_bootstrap.cc:492] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2: Bootstrap starting.
I20260619 02:48:36.384452 31962 tablet_bootstrap.cc:492] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Bootstrap starting.
I20260619 02:48:36.384598 31960 tablet_bootstrap.cc:654] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:36.384987 31960 log.cc:824] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:36.385139 31962 tablet_bootstrap.cc:654] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:36.385413 31962 log.cc:824] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:36.385756 31961 tablet_bootstrap.cc:492] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Bootstrap starting.
I20260619 02:48:36.385794 31960 tablet_bootstrap.cc:492] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2: No bootstrap required, opened a new log
I20260619 02:48:36.385848 31960 ts_tablet_manager.cc:1397] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:36.386104 31962 tablet_bootstrap.cc:492] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: No bootstrap required, opened a new log
I20260619 02:48:36.386180 31962 ts_tablet_manager.cc:1397] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:36.386387 31961 tablet_bootstrap.cc:654] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:36.386772 31961 log.cc:824] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:36.387531 31961 tablet_bootstrap.cc:492] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: No bootstrap required, opened a new log
I20260619 02:48:36.387598 31961 ts_tablet_manager.cc:1397] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260619 02:48:36.388465 31962 raft_consensus.cc:348] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.388494 31960 raft_consensus.cc:348] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.388618 31962 raft_consensus.cc:374] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:36.388661 31962 raft_consensus.cc:729] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5749851130cb481397f7cbb44b5a9c18, State: Initialized, Role: FOLLOWER
I20260619 02:48:36.388664 31960 raft_consensus.cc:374] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:36.388695 31960 raft_consensus.cc:729] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c1b0555393a40c7a170cbc93fd304b2, State: Initialized, Role: FOLLOWER
I20260619 02:48:36.388772 31962 consensus_queue.cc:260] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.388818 31960 consensus_queue.cc:260] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.389029 31962 ts_tablet_manager.cc:1428] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:48:36.389063 31960 ts_tablet_manager.cc:1428] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260619 02:48:36.389143 31946 heartbeater.cc:503] Master 127.12.145.126:45449 was elected leader, sending a full tablet report...
I20260619 02:48:36.389230 31684 heartbeater.cc:503] Master 127.12.145.126:45449 was elected leader, sending a full tablet report...
I20260619 02:48:36.389967 31961 raft_consensus.cc:348] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.390117 31961 raft_consensus.cc:374] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:36.390184 31961 raft_consensus.cc:729] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2b84c7650844e51aa44d1dc1aa882cb, State: Initialized, Role: FOLLOWER
I20260619 02:48:36.390303 31961 consensus_queue.cc:260] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.390576 31961 ts_tablet_manager.cc:1428] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260619 02:48:36.390605 31815 heartbeater.cc:503] Master 127.12.145.126:45449 was elected leader, sending a full tablet report...
W20260619 02:48:36.487710 31816 tablet.cc:2369] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:48:36.546514 31967 raft_consensus.cc:482] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:36.546664 31967 raft_consensus.cc:504] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.547096 31967 leader_election.cc:288] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5749851130cb481397f7cbb44b5a9c18 (127.12.145.67:33781), f2b84c7650844e51aa44d1dc1aa882cb (127.12.145.66:44591)
I20260619 02:48:36.550103 31686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.547326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:33781 (local address 127.12.145.65:34339)
0619 02:48:36.547393 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.547408 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.547480 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.547633 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.547635 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.547636 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:36.547709 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.547711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.548445 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.548446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.549235 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.549237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.549838 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.549840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.549910 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.549913 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.549976 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.550007 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260619 02:48:36.550124 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.547404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:34339 (local address 127.12.145.67:33781)
0619 02:48:36.547475 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.547477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.547489 (+ 12us) server_negotiation.cc:407] Connection header received
0619 02:48:36.547531 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.547532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.547543 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.547603 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:36.547797 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.548359 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.549328 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.549734 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.549807 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.549813 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.550003 (+ 190us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.550047 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260619 02:48:36.550203 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.547638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:36775 (local address 127.12.145.66:44591)
0619 02:48:36.547689 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.547691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.547700 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:36.547758 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.547759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.547768 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.547832 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:36.547983 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.548490 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.549419 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.549753 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.549863 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.549871 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.550058 (+ 187us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.550128 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:48:36.550213 31969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.547456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:44591 (local address 127.12.145.65:36775)
0619 02:48:36.547643 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.547652 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:36.547705 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:36.547842 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:36.547842 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:36.547844 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:36.547917 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.547918 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.548575 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.548576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.549321 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:36.549324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.549886 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.549887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:36.549976 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.549980 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:36.550038 (+ 58us) client_negotiation.cc:240] Negotiation successful
0619 02:48:36.550069 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":111,"threads_started":1}
I20260619 02:48:36.550427 31900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d465562efd194b729b20c8a66c02fe6b" candidate_uuid: "9c1b0555393a40c7a170cbc93fd304b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5749851130cb481397f7cbb44b5a9c18" is_pre_election: true
I20260619 02:48:36.550630 31900 raft_consensus.cc:2454] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c1b0555393a40c7a170cbc93fd304b2 in term 0.
I20260619 02:48:36.550741 31769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d465562efd194b729b20c8a66c02fe6b" candidate_uuid: "9c1b0555393a40c7a170cbc93fd304b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" is_pre_election: true
I20260619 02:48:36.550853 31571 leader_election.cc:302] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5749851130cb481397f7cbb44b5a9c18, 9c1b0555393a40c7a170cbc93fd304b2; no voters:
I20260619 02:48:36.550892 31769 raft_consensus.cc:2454] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c1b0555393a40c7a170cbc93fd304b2 in term 0.
I20260619 02:48:36.550977 31967 raft_consensus.cc:2781] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:48:36.551040 31967 raft_consensus.cc:482] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:48:36.551077 31967 raft_consensus.cc:3037] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:36.551831 31967 raft_consensus.cc:504] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.551952 31967 leader_election.cc:288] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [CANDIDATE]: Term 1 election: Requested vote from peers 5749851130cb481397f7cbb44b5a9c18 (127.12.145.67:33781), f2b84c7650844e51aa44d1dc1aa882cb (127.12.145.66:44591)
I20260619 02:48:36.552122 31769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d465562efd194b729b20c8a66c02fe6b" candidate_uuid: "9c1b0555393a40c7a170cbc93fd304b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2b84c7650844e51aa44d1dc1aa882cb"
I20260619 02:48:36.552143 31900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d465562efd194b729b20c8a66c02fe6b" candidate_uuid: "9c1b0555393a40c7a170cbc93fd304b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5749851130cb481397f7cbb44b5a9c18"
I20260619 02:48:36.552196 31900 raft_consensus.cc:3037] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:36.552199 31769 raft_consensus.cc:3037] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:36.552867 31900 raft_consensus.cc:2454] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c1b0555393a40c7a170cbc93fd304b2 in term 1.
I20260619 02:48:36.552970 31769 raft_consensus.cc:2454] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c1b0555393a40c7a170cbc93fd304b2 in term 1.
I20260619 02:48:36.553032 31571 leader_election.cc:302] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5749851130cb481397f7cbb44b5a9c18, 9c1b0555393a40c7a170cbc93fd304b2; no voters:
I20260619 02:48:36.553123 31967 raft_consensus.cc:2781] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:36.553268 31967 raft_consensus.cc:686] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [term 1 LEADER]: Becoming Leader. State: Replica: 9c1b0555393a40c7a170cbc93fd304b2, State: Running, Role: LEADER
I20260619 02:48:36.553380 31967 consensus_queue.cc:237] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } }
I20260619 02:48:36.554231 31496 catalog_manager.cc:5495] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c1b0555393a40c7a170cbc93fd304b2 (127.12.145.65). New cstate: current_term: 1 leader_uuid: "9c1b0555393a40c7a170cbc93fd304b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c1b0555393a40c7a170cbc93fd304b2" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 45893 } health_report { overall_health: HEALTHY } } }
I20260619 02:48:36.560608 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.558389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59580 (local address 127.12.145.65:45893)
0619 02:48:36.558432 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:36.558434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:36.558443 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:36.558518 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:36.558519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:36.558535 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:36.558613 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:48:36.558716 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.559157 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.559856 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:36.560034 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:36.560142 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:36.560280 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:48:36.560367 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:48:36.560469 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:36.560506 (+ 37us) server_negotiation.cc:299] Negotiation successful
0619 02:48:36.560515 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:48:36.562261 31769 raft_consensus.cc:1261] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 1 FOLLOWER]: Refusing update from remote peer 9c1b0555393a40c7a170cbc93fd304b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:36.562271 31900 raft_consensus.cc:1261] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 1 FOLLOWER]: Refusing update from remote peer 9c1b0555393a40c7a170cbc93fd304b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:36.562582 31967 consensus_queue.cc:1035] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2b84c7650844e51aa44d1dc1aa882cb" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 44591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:36.562705 31970 consensus_queue.cc:1035] T d465562efd194b729b20c8a66c02fe6b P 9c1b0555393a40c7a170cbc93fd304b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5749851130cb481397f7cbb44b5a9c18" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:36.565181 31974 mvcc.cc:205] Tried to move back new op lower bound from 7298405648636477440 to 7298405648603181056. Current Snapshot: MvccSnapshot[applied={T|T < 7298405648636477440}]
I20260619 02:48:36.565341 31975 mvcc.cc:205] Tried to move back new op lower bound from 7298405648636477440 to 7298405648603181056. Current Snapshot: MvccSnapshot[applied={T|T < 7298405648636477440}]
I20260619 02:48:36.567062 31496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:36.567159 31496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:36.567869 31496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 408a0a0cfbff4aca84df542e3a04b730: Sending DeleteTablet for 3 replicas of tablet d465562efd194b729b20c8a66c02fe6b
I20260619 02:48:36.568213 31618 tablet_service.cc:1514] Processing DeleteTablet for tablet d465562efd194b729b20c8a66c02fe6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:36 UTC) from {username='slave'} at 127.0.0.1:59574
I20260619 02:48:36.568259 31880 tablet_service.cc:1514] Processing DeleteTablet for tablet d465562efd194b729b20c8a66c02fe6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:36 UTC) from {username='slave'} at 127.0.0.1:47938
I20260619 02:48:36.568270 31749 tablet_service.cc:1514] Processing DeleteTablet for tablet d465562efd194b729b20c8a66c02fe6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:36 UTC) from {username='slave'} at 127.0.0.1:41564
I20260619 02:48:36.568475 31984 tablet_replica.cc:330] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: stopping tablet replica
I20260619 02:48:36.568488 31982 tablet_replica.cc:330] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: stopping tablet replica
I20260619 02:48:36.568568 31982 raft_consensus.cc:2229] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:36.568568 31984 raft_consensus.cc:2229] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:36.568655 31982 raft_consensus.cc:2258] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:36.568650 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 31556
I20260619 02:48:36.569276 31984 raft_consensus.cc:2258] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:36.569756 31984 ts_tablet_manager.cc:1905] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:36.571026 31982 ts_tablet_manager.cc:1905] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:36.571223 31984 ts_tablet_manager.cc:1918] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:36.571291 31984 log.cc:1196] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/d465562efd194b729b20c8a66c02fe6b
I20260619 02:48:36.571527 31984 ts_tablet_manager.cc:1939] T d465562efd194b729b20c8a66c02fe6b P f2b84c7650844e51aa44d1dc1aa882cb: Deleting consensus metadata
I20260619 02:48:36.571928 31480 catalog_manager.cc:4841] TS f2b84c7650844e51aa44d1dc1aa882cb (127.12.145.66:44591): tablet d465562efd194b729b20c8a66c02fe6b (table test-table [id=8401f7ae44854d76b09d5f02bb7ed115]) successfully deleted
I20260619 02:48:36.572557 31982 ts_tablet_manager.cc:1918] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:36.572614 31982 log.cc:1196] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/d465562efd194b729b20c8a66c02fe6b
I20260619 02:48:36.572851 31982 ts_tablet_manager.cc:1939] T d465562efd194b729b20c8a66c02fe6b P 5749851130cb481397f7cbb44b5a9c18: Deleting consensus metadata
I20260619 02:48:36.573247 31480 catalog_manager.cc:4841] TS 5749851130cb481397f7cbb44b5a9c18 (127.12.145.67:33781): tablet d465562efd194b729b20c8a66c02fe6b (table test-table [id=8401f7ae44854d76b09d5f02bb7ed115]) successfully deleted
W20260619 02:48:36.574348 31482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:45893 (error 108)
I20260619 02:48:36.574855 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:36.574728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:45893 (local address 127.0.0.1:59588)
0619 02:48:36.574781 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:36.574820 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:45893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260619 02:48:36.574848 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 31687
W20260619 02:48:36.575415 31482 catalog_manager.cc:4584] TS 9c1b0555393a40c7a170cbc93fd304b2 (127.12.145.65:45893): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d465562efd194b729b20c8a66c02fe6b: Network error: Client connection negotiation failed: client connection to 127.12.145.65:45893: connect: Connection refused (error 111)
I20260619 02:48:36.580380 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 31818
I20260619 02:48:36.584996 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 31465
2026-06-19T02:48:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (790 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:36 dist-test-slave-fbl4 krb5kdc[31988](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:36 dist-test-slave-fbl4 krb5kdc[31988](info): set up 2 sockets
Jun 19 02:48:36 dist-test-slave-fbl4 krb5kdc[31988](info): commencing operation
krb5kdc: starting...
W20260619 02:48:37.618665 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:37 dist-test-slave-fbl4 krb5kdc[31988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:48:37.735577 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34203
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:37.815508 32001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:37.815716 32001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:37.815738 32001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:37.816905 32001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:37.816946 32001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:37.816962 32001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:37.816999 32001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:37.817031 32001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:37.818481 32001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:37.818743 32001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:37.818974 32001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:37.823781 32006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:37.823951 32001 server_base.cc:1034] running on GCE node
W20260619 02:48:37.823774 32007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:37.824045 32009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:37.824337 32001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:37.824698 32001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:37.825870 32001 hybrid_clock.cc:648] HybridClock initialized: now 1781837317825849 us; error 36 us; skew 500 ppm
Jun 19 02:48:37 dist-test-slave-fbl4 krb5kdc[31988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837317, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:37.829486 32001 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:48:37.830057 32001 webserver.cc:460] Webserver started at http://127.12.145.126:46559/ using document root <none> and password file <none>
I20260619 02:48:37.830304 32001 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:37.830348 32001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:37.830476 32001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:37.831969 32001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "bda8444933494ca08a551b31b3152d41"
format_stamp: "Formatted at 2026-06-19 02:48:37 on dist-test-slave-fbl4"
server_key: "a4936832a6d0660379de4c817cb1cbe7"
server_key_iv: "10796e88688c97fb54c474f870036701"
server_key_version: "encryptionkey@0"
I20260619 02:48:37.832377 32001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "bda8444933494ca08a551b31b3152d41"
format_stamp: "Formatted at 2026-06-19 02:48:37 on dist-test-slave-fbl4"
server_key: "a4936832a6d0660379de4c817cb1cbe7"
server_key_iv: "10796e88688c97fb54c474f870036701"
server_key_version: "encryptionkey@0"
I20260619 02:48:37.833711 32001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:48:37.834438 32016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:37.834666 32001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:37.834754 32001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "bda8444933494ca08a551b31b3152d41"
format_stamp: "Formatted at 2026-06-19 02:48:37 on dist-test-slave-fbl4"
server_key: "a4936832a6d0660379de4c817cb1cbe7"
server_key_iv: "10796e88688c97fb54c474f870036701"
server_key_version: "encryptionkey@0"
I20260619 02:48:37.834831 32001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:37.845199 32001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:37.847013 32001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:37.847157 32001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:37.850927 32001 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:34203
I20260619 02:48:37.850970 32068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:34203 every 8 connection(s)
I20260619 02:48:37.851289 32001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:37.852133 32069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:37.854297 32069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41: Bootstrap starting.
I20260619 02:48:37.854916 32069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:37.855190 32069 log.cc:824] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:37.855831 32069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41: No bootstrap required, opened a new log
I20260619 02:48:37.857336 32069 raft_consensus.cc:348] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda8444933494ca08a551b31b3152d41" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34203 } }
I20260619 02:48:37.857484 32069 raft_consensus.cc:374] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:37.857530 32069 raft_consensus.cc:729] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda8444933494ca08a551b31b3152d41, State: Initialized, Role: FOLLOWER
I20260619 02:48:37.857728 32069 consensus_queue.cc:260] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda8444933494ca08a551b31b3152d41" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34203 } }
I20260619 02:48:37.857836 32069 raft_consensus.cc:388] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:37.857880 32069 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:37.857932 32069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:37.858428 32069 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda8444933494ca08a551b31b3152d41" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34203 } }
I20260619 02:48:37.858539 32069 leader_election.cc:302] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bda8444933494ca08a551b31b3152d41; no voters:
I20260619 02:48:37.858736 32069 leader_election.cc:288] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:37.858762 32072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:37.858950 32072 raft_consensus.cc:686] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [term 1 LEADER]: Becoming Leader. State: Replica: bda8444933494ca08a551b31b3152d41, State: Running, Role: LEADER
I20260619 02:48:37.859004 32069 sys_catalog.cc:564] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:37.859040 32072 consensus_queue.cc:237] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda8444933494ca08a551b31b3152d41" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34203 } }
I20260619 02:48:37.859617 32073 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bda8444933494ca08a551b31b3152d41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda8444933494ca08a551b31b3152d41" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34203 } } }
I20260619 02:48:37.859717 32073 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:37.859901 32074 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bda8444933494ca08a551b31b3152d41. Latest consensus state: current_term: 1 leader_uuid: "bda8444933494ca08a551b31b3152d41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda8444933494ca08a551b31b3152d41" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34203 } } }
I20260619 02:48:37.859941 32081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:37.859968 32074 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:37.860270 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 32001
I20260619 02:48:37.860394 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:37.860595 12869 external_mini_cluster.cc:1428] Setting key 8eb942188cfa4c2953f466ab569be1cd
I20260619 02:48:37.861189 32081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:37.862959 32081 catalog_manager.cc:1347] Generated new cluster ID: e6a6d7795b2b4a189cb8b5247a0217ae
I20260619 02:48:37.863013 32081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:48:37 dist-test-slave-fbl4 krb5kdc[31988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:37.870703 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:37.861104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44772 (local address 127.12.145.126:34203)
0619 02:48:37.861358 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:37.861367 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:37.861402 (+ 35us) server_negotiation.cc:407] Connection header received
0619 02:48:37.861519 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:37.861526 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:37.861589 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:37.861731 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:37.862383 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:37.863791 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:37.864528 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:37.865101 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:37.865200 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:37.867464 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:37.867469 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:37.867469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:37.867481 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:37.869150 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:37.869530 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:37.869533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:37.869533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:37.869636 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:37.869844 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:37.869845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:37.869845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:37.870080 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:37.870240 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:37.870336 (+ 96us) server_negotiation.cc:299] Negotiation successful
0619 02:48:37.870473 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":100,"threads_started":1}
I20260619 02:48:37.892867 32081 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:37.893422 32081 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:37.897022 32081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41: Generated new TSK 0
I20260619 02:48:37.897253 32081 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.145.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
Entry for principal kudu/127.12.145.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab.
I20260619 02:48:37.931613 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34203
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:38.013790 32095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:38.014024 32095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:38.014063 32095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:38.015290 32095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:38.015352 32095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:38.015398 32095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:48:38.016824 32095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.65.keytab
--principal=kudu/127.12.145.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:38.017097 32095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:38.017328 32095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:38.022080 32103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:38.022035 32101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:38.022033 32100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:38.022287 32095 server_base.cc:1034] running on GCE node
I20260619 02:48:38.022509 32095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:38.022856 32095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:38.024044 32095 hybrid_clock.cc:648] HybridClock initialized: now 1781837318024015 us; error 41 us; skew 500 ppm
Jun 19 02:48:38 dist-test-slave-fbl4 krb5kdc[31988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:38.026623 32095 init.cc:377] Logged in from keytab as kudu/127.12.145.65@KRBTEST.COM (short username kudu)
I20260619 02:48:38.027071 32095 webserver.cc:460] Webserver started at http://127.12.145.65:37581/ using document root <none> and password file <none>
I20260619 02:48:38.027321 32095 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:38.027387 32095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:38.027544 32095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:38.028589 32095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "f7de46fb598c4c72a9f8a426bfbf9964"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "9a43418a623101d5fb705cd670962556"
server_key_iv: "cee61494abb6c3245b6062883310bd4b"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.028959 32095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "f7de46fb598c4c72a9f8a426bfbf9964"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "9a43418a623101d5fb705cd670962556"
server_key_iv: "cee61494abb6c3245b6062883310bd4b"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.030303 32095 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:38.031141 32110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.031320 32095 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.031409 32095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "f7de46fb598c4c72a9f8a426bfbf9964"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "9a43418a623101d5fb705cd670962556"
server_key_iv: "cee61494abb6c3245b6062883310bd4b"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.031492 32095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:38.037865 32095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:38.039913 32095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:38.040079 32095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:38.040295 32095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:38.040584 32095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:38.040635 32095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.040675 32095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:38.040704 32095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.046619 32095 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:43487
I20260619 02:48:38.046639 32223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:43487 every 8 connection(s)
I20260619 02:48:38.046969 32095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
Jun 19 02:48:38 dist-test-slave-fbl4 krb5kdc[31988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.65@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:38.055861 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.047690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:56771 (local address 127.12.145.126:34203)
0619 02:48:38.047733 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.047735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.047929 (+ 194us) server_negotiation.cc:407] Connection header received
0619 02:48:38.048390 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.048390 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.048403 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.048468 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:38.049338 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.049865 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.050896 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.051108 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.051172 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.053114 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:38.053115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:38.053116 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:38.053122 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:38.054681 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.055022 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.055023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.055023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.055076 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.055311 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.055312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.055313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.055428 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:38.055489 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.055717 (+ 228us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.055793 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:48:38.055998 32226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.047651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34203 (local address 127.12.145.65:56771)
0619 02:48:38.047801 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.047843 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.048308 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.048522 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.048525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.049067 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:38.049257 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.049262 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.049947 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.049947 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.050798 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.050800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.051186 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.051187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.051280 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.051723 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:38.051731 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:38.053022 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:38.054746 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:38.054751 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:38.054753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:38.054950 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:38.055137 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:38.055137 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:38.055137 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:38.055227 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:38.055488 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:38.055493 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:38.055606 (+ 113us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.055684 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.055795 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
I20260619 02:48:38.056444 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 32095
I20260619 02:48:38.056510 32224 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34203
I20260619 02:48:38.056564 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:48:38.056619 32224 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:38.056799 12869 external_mini_cluster.cc:1428] Setting key b0696ba0481b2bffd15a76fc5abc0f7c
I20260619 02:48:38.056818 32224 heartbeater.cc:511] Master 127.12.145.126:34203 requested a full tablet report, sending...
I20260619 02:48:38.057405 32032 ts_manager.cc:194] Registered new tserver with Master: f7de46fb598c4c72a9f8a426bfbf9964 (127.12.145.65:43487)
I20260619 02:48:38.058341 32032 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.65@KRBTEST.COM'} at 127.12.145.65:56771
WARNING: no policy specified for kudu/127.12.145.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
Entry for principal kudu/127.12.145.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab.
I20260619 02:48:38.081200 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34203
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:38.161792 32229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:38.161980 32229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:38.162003 32229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:38.163085 32229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:38.163120 32229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:38.163146 32229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:48:38.164485 32229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.66.keytab
--principal=kudu/127.12.145.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:38.164659 32229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:38.164829 32229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:38.169761 32234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:38.169886 32235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:38.169866 32229 server_base.cc:1034] running on GCE node
W20260619 02:48:38.169729 32237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:38.170176 32229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:38.170423 32229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:38.171599 32229 hybrid_clock.cc:648] HybridClock initialized: now 1781837318171593 us; error 38 us; skew 500 ppm
Jun 19 02:48:38 dist-test-slave-fbl4 krb5kdc[31988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:38.174058 32229 init.cc:377] Logged in from keytab as kudu/127.12.145.66@KRBTEST.COM (short username kudu)
I20260619 02:48:38.174407 32229 webserver.cc:460] Webserver started at http://127.12.145.66:38817/ using document root <none> and password file <none>
I20260619 02:48:38.174674 32229 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:38.174721 32229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:38.174809 32229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:38.175777 32229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "545d2fafca4b48778ae8906901f5cd14"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "8f8154decb2c40ec0d5ab72b0ee017e4"
server_key_iv: "3fff06febb50ee15ce9bfd75872c9eab"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.176069 32229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "545d2fafca4b48778ae8906901f5cd14"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "8f8154decb2c40ec0d5ab72b0ee017e4"
server_key_iv: "3fff06febb50ee15ce9bfd75872c9eab"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.177273 32229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:48:38.177973 32244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.178190 32229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:48:38.178263 32229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "545d2fafca4b48778ae8906901f5cd14"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "8f8154decb2c40ec0d5ab72b0ee017e4"
server_key_iv: "3fff06febb50ee15ce9bfd75872c9eab"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.178354 32229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:38.201304 32229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:38.203604 32229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:38.203779 32229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:38.204018 32229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:38.204321 32229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:38.204355 32229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.204398 32229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:38.204428 32229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.210023 32229 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:45619
I20260619 02:48:38.210144 32357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:45619 every 8 connection(s)
I20260619 02:48:38.210402 32229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:48:38.215917 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 32229
I20260619 02:48:38.216045 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:48:38.216244 12869 external_mini_cluster.cc:1428] Setting key a5ab7ef4e1066ac627709d0124ca3dce
Jun 19 02:48:38 dist-test-slave-fbl4 krb5kdc[31988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.66@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:38.219985 32360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.211131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34203 (local address 127.12.145.66:44905)
0619 02:48:38.211302 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.211336 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.211811 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.212058 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.212061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.212611 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:38.212799 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.212804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.213517 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.213518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.214303 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.214305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.214736 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.214737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.214862 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.215281 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:38.215289 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:38.216817 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:38.218663 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:38.218670 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:38.218672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:38.218885 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:38.219122 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:38.219123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:38.219123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:38.219226 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:38.219513 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:38.219517 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:38.219627 (+ 110us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.219707 (+ 80us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.219825 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":86,"threads_started":1}
I20260619 02:48:38.219988 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.211153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:44905 (local address 127.12.145.126:34203)
0619 02:48:38.211216 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.211218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.211420 (+ 202us) server_negotiation.cc:407] Connection header received
0619 02:48:38.211921 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.211922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.211933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.211994 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:38.212902 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.213432 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.214384 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.214654 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.214723 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.216933 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:38.216935 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:38.216935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:38.216943 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:38.218570 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.218961 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.218962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.218963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.219033 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.219290 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.219291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.219292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.219439 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:38.219521 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.219753 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.219846 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260619 02:48:38.220525 32358 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34203
I20260619 02:48:38.220634 32358 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:38.220836 32358 heartbeater.cc:511] Master 127.12.145.126:34203 requested a full tablet report, sending...
I20260619 02:48:38.221367 32032 ts_manager.cc:194] Registered new tserver with Master: 545d2fafca4b48778ae8906901f5cd14 (127.12.145.66:45619)
I20260619 02:48:38.221746 32032 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.66@KRBTEST.COM'} at 127.12.145.66:44905
WARNING: no policy specified for kudu/127.12.145.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
Entry for principal kudu/127.12.145.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab.
I20260619 02:48:38.241954 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34203
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:38.321226 32363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:38.321429 32363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:38.321451 32363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:38.322655 32363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:38.322695 32363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:38.322722 32363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:48:38.324162 32363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.67.keytab
--principal=kudu/127.12.145.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:38.324407 32363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:38.324640 32363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:38.329521 32368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:38.329511 32369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:38.329536 32371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:38.329800 32363 server_base.cc:1034] running on GCE node
I20260619 02:48:38.330024 32363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:38.330343 32363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:38.331525 32363 hybrid_clock.cc:648] HybridClock initialized: now 1781837318331487 us; error 66 us; skew 500 ppm
Jun 19 02:48:38 dist-test-slave-fbl4 krb5kdc[31988](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:38.334147 32363 init.cc:377] Logged in from keytab as kudu/127.12.145.67@KRBTEST.COM (short username kudu)
I20260619 02:48:38.334738 32363 webserver.cc:460] Webserver started at http://127.12.145.67:46653/ using document root <none> and password file <none>
I20260619 02:48:38.334978 32363 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:38.335054 32363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:38.335208 32363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:38.336298 32363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "5da1866fb65f484086c4fa02c9722d95"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "e6fa253e3ce0f568a872bea9d38b3f21"
server_key_iv: "e9a049386e8561c71a2196b9fb123ff0"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.336732 32363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "5da1866fb65f484086c4fa02c9722d95"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "e6fa253e3ce0f568a872bea9d38b3f21"
server_key_iv: "e9a049386e8561c71a2196b9fb123ff0"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.338393 32363 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:38.339393 32378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.339666 32363 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:38.339772 32363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "5da1866fb65f484086c4fa02c9722d95"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "e6fa253e3ce0f568a872bea9d38b3f21"
server_key_iv: "e9a049386e8561c71a2196b9fb123ff0"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.339855 32363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:38.352645 32363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:38.354862 32363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:38.355026 32363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:38.355273 32363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:38.355607 32363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:38.355674 32363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.355719 32363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:38.355746 32363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.361718 32363 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:33583
I20260619 02:48:38.361757 32491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:33583 every 8 connection(s)
I20260619 02:48:38.362105 32363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:48:38.366786 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 32363
I20260619 02:48:38.366912 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:48:38.367198 12869 external_mini_cluster.cc:1428] Setting key ccd00f1416cadf4282589483f9a1150b
Jun 19 02:48:38 dist-test-slave-fbl4 krb5kdc[31988](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.67@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:38.371496 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.362842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:58789 (local address 127.12.145.126:34203)
0619 02:48:38.362925 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.362928 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.363197 (+ 269us) server_negotiation.cc:407] Connection header received
0619 02:48:38.363649 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.363650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.363660 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.363724 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:38.364655 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.365169 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.366226 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.366410 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.366471 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.369021 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:38.369022 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:38.369022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:38.369028 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:38.370166 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.370586 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.370587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.370588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.370645 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.370953 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.370953 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.370954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.371065 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:38.371119 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.371373 (+ 254us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.371433 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 02:48:38.371726 32494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.362816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34203 (local address 127.12.145.67:58789)
0619 02:48:38.363008 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.363087 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.363562 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.363778 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.363781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.364368 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:38.364562 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.364567 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.365271 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.365272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.366068 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.366071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.366496 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.366497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.366663 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.367227 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:48:38.367236 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:38.368956 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:38.370247 (+ 1291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:38.370252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:38.370254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:38.370470 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:38.370714 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:48:38.370715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:48:38.370716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:48:38.370871 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:48:38.371129 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:38.371134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:38.371256 (+ 122us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.371343 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.371464 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":112,"threads_started":1}
I20260619 02:48:38.372283 32492 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34203
I20260619 02:48:38.372394 32492 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:38.372582 32492 heartbeater.cc:511] Master 127.12.145.126:34203 requested a full tablet report, sending...
I20260619 02:48:38.372949 32032 ts_manager.cc:194] Registered new tserver with Master: 5da1866fb65f484086c4fa02c9722d95 (127.12.145.67:33583)
I20260619 02:48:38.373355 32032 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.145.67@KRBTEST.COM'} at 127.12.145.67:58789
I20260619 02:48:38.379701 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:48:38.386811 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.381122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44784 (local address 127.12.145.126:34203)
0619 02:48:38.381183 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.381185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.381216 (+ 31us) server_negotiation.cc:407] Connection header received
0619 02:48:38.381286 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.381287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.381295 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.381344 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:38.381887 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.382432 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.383186 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.383367 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.383420 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.384628 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:38.384629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:38.384629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:38.384635 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:38.385813 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.386123 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.386123 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.386124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.386172 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:38.386339 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:38.386339 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:38.386339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:38.386473 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:38.386605 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.386685 (+ 80us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.386745 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260619 02:48:38.388281 32032 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:48:38.389773 32032 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:48:38.395953 32500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.391896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:45619 (local address 127.0.0.1:52628)
0619 02:48:38.392297 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.392306 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.392359 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.392612 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.392615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.392618 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:38.392681 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.392683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.393608 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.393608 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.394655 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.394658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.395615 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.395616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.395708 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.395730 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.395812 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.395871 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":2,"thread_start_us":59,"threads_started":1}
I20260619 02:48:38.395962 32504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.392098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52628 (local address 127.12.145.66:45619)
0619 02:48:38.392253 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.392258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.392352 (+ 94us) server_negotiation.cc:407] Connection header received
0619 02:48:38.392423 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.392425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.392444 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.392517 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:38.392771 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.393509 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.394765 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.395515 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.395586 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.395645 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.395835 (+ 190us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.395878 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260619 02:48:38.396307 32501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.391896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:43487 (local address 127.0.0.1:57036)
0619 02:48:38.392111 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.392156 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.392239 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.392742 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.392743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.392745 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:38.392787 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.392788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.394142 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.394143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.395108 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.395111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.395939 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.395940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.396136 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.396141 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.396191 (+ 50us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.396237 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":33,"spinlock_wait_cycles":896,"thread_start_us":68,"threads_started":1}
I20260619 02:48:38.396503 32503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.392087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:33583 (local address 127.0.0.1:51522)
0619 02:48:38.392433 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.392444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.392517 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.392793 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.392794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.392796 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:38.392873 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.392875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.394143 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.394144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.395300 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.395303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.396266 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.396267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.396325 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.396329 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.396390 (+ 61us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.396439 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":20,"thread_start_us":42,"threads_started":1}
I20260619 02:48:38.396673 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.392003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57036 (local address 127.12.145.65:43487)
0619 02:48:38.392501 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.392505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.392514 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:38.392551 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.392553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.392568 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.392637 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:38.392872 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.394017 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.395208 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.395793 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.395854 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.395907 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.396485 (+ 578us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.396530 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":109,"threads_started":1}
I20260619 02:48:38.396850 32292 tablet_service.cc:1467] Processing CreateTablet for tablet c0505ba0d1044c01836c3abcedd98a51 (DEFAULT_TABLE table=test-table [id=fc86713d45aa496b95695b6f4cf0b5c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:38.396991 32505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.392256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51522 (local address 127.12.145.67:33583)
0619 02:48:38.392422 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.392427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.392589 (+ 162us) server_negotiation.cc:407] Connection header received
0619 02:48:38.392633 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.392635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.392652 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.392724 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:38.392957 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.394035 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.395394 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.396105 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.396173 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.396230 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.396679 (+ 449us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.396893 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260619 02:48:38.397229 32292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0505ba0d1044c01836c3abcedd98a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:38.397598 32426 tablet_service.cc:1467] Processing CreateTablet for tablet c0505ba0d1044c01836c3abcedd98a51 (DEFAULT_TABLE table=test-table [id=fc86713d45aa496b95695b6f4cf0b5c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:38.397897 32426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0505ba0d1044c01836c3abcedd98a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:38.400117 32506 tablet_bootstrap.cc:492] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Bootstrap starting.
I20260619 02:48:38.400558 32507 tablet_bootstrap.cc:492] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Bootstrap starting.
I20260619 02:48:38.400511 32158 tablet_service.cc:1467] Processing CreateTablet for tablet c0505ba0d1044c01836c3abcedd98a51 (DEFAULT_TABLE table=test-table [id=fc86713d45aa496b95695b6f4cf0b5c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:38.400853 32158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0505ba0d1044c01836c3abcedd98a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:38.400943 32506 tablet_bootstrap.cc:654] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:38.401207 32507 tablet_bootstrap.cc:654] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:38.401456 32506 log.cc:824] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:38.401789 32507 log.cc:824] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:38.402201 32506 tablet_bootstrap.cc:492] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: No bootstrap required, opened a new log
I20260619 02:48:38.402267 32506 ts_tablet_manager.cc:1397] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:38.402566 32507 tablet_bootstrap.cc:492] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: No bootstrap required, opened a new log
I20260619 02:48:38.402645 32507 ts_tablet_manager.cc:1397] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:38.403949 32506 raft_consensus.cc:348] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.404141 32506 raft_consensus.cc:374] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:38.404192 32506 raft_consensus.cc:729] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 545d2fafca4b48778ae8906901f5cd14, State: Initialized, Role: FOLLOWER
I20260619 02:48:38.404284 32510 tablet_bootstrap.cc:492] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964: Bootstrap starting.
I20260619 02:48:38.404310 32506 consensus_queue.cc:260] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.404592 32358 heartbeater.cc:503] Master 127.12.145.126:34203 was elected leader, sending a full tablet report...
I20260619 02:48:38.404597 32506 ts_tablet_manager.cc:1428] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 02:48:38.404922 32510 tablet_bootstrap.cc:654] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:38.404891 32507 raft_consensus.cc:348] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.405081 32507 raft_consensus.cc:374] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:38.405124 32507 raft_consensus.cc:729] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da1866fb65f484086c4fa02c9722d95, State: Initialized, Role: FOLLOWER
I20260619 02:48:38.405249 32507 consensus_queue.cc:260] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.405519 32507 ts_tablet_manager.cc:1428] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:48:38.405514 32510 log.cc:824] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:38.405660 32492 heartbeater.cc:503] Master 127.12.145.126:34203 was elected leader, sending a full tablet report...
I20260619 02:48:38.406265 32510 tablet_bootstrap.cc:492] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964: No bootstrap required, opened a new log
I20260619 02:48:38.406315 32510 ts_tablet_manager.cc:1397] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:38.407927 32510 raft_consensus.cc:348] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.408051 32510 raft_consensus.cc:374] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:38.408079 32510 raft_consensus.cc:729] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7de46fb598c4c72a9f8a426bfbf9964, State: Initialized, Role: FOLLOWER
I20260619 02:48:38.408188 32510 consensus_queue.cc:260] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.408464 32510 ts_tablet_manager.cc:1428] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 02:48:38.408473 32224 heartbeater.cc:503] Master 127.12.145.126:34203 was elected leader, sending a full tablet report...
W20260619 02:48:38.460986 32359 tablet.cc:2369] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:48:38.547761 32225 tablet.cc:2369] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 02:48:38.612661 32493 tablet.cc:2369] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 02:48:38.727497 32512 raft_consensus.cc:482] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:38.727648 32512 raft_consensus.cc:504] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.728039 32512 leader_election.cc:288] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7de46fb598c4c72a9f8a426bfbf9964 (127.12.145.65:43487), 545d2fafca4b48778ae8906901f5cd14 (127.12.145.66:45619)
I20260619 02:48:38.730865 32494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.728253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:45619 (local address 127.12.145.67:40459)
0619 02:48:38.728328 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.728341 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.728393 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.728549 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.728550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.728552 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:38.728645 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.728646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.729286 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.729287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.730045 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.730047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.730602 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.730603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.730682 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.730684 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.730750 (+ 66us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.730793 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":1}
I20260619 02:48:38.730863 32504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.728326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:40459 (local address 127.12.145.66:45619)
0619 02:48:38.728410 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.728412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.728422 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:48:38.728461 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.728462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.728473 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.728545 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:38.728721 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.729201 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.730141 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.730490 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.730590 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.730600 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.730755 (+ 155us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.730792 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 02:48:38.730966 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.728349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:57681 (local address 127.12.145.65:43487)
0619 02:48:38.728400 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.728402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.728545 (+ 143us) server_negotiation.cc:407] Connection header received
0619 02:48:38.728627 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.728628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.728636 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.728702 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:38.728854 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.729318 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.730212 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.730623 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.730708 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.730716 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.730869 (+ 153us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.730903 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260619 02:48:38.730978 32515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.728261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:43487 (local address 127.12.145.67:57681)
0619 02:48:38.728463 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.728473 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:38.728560 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:38.728705 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:38.728706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:38.728707 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:38.728784 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.728786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.729401 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.729402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.730121 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:38.730123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.730710 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.730710 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:38.730782 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.730791 (+ 9us) client_negotiation.cc:769] Sending connection context
0619 02:48:38.730861 (+ 70us) client_negotiation.cc:240] Negotiation successful
0619 02:48:38.730898 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":67,"thread_start_us":93,"threads_started":1}
I20260619 02:48:38.731230 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0505ba0d1044c01836c3abcedd98a51" candidate_uuid: "5da1866fb65f484086c4fa02c9722d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "545d2fafca4b48778ae8906901f5cd14" is_pre_election: true
I20260619 02:48:38.731410 32312 raft_consensus.cc:2454] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5da1866fb65f484086c4fa02c9722d95 in term 0.
I20260619 02:48:38.731374 32178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0505ba0d1044c01836c3abcedd98a51" candidate_uuid: "5da1866fb65f484086c4fa02c9722d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" is_pre_election: true
I20260619 02:48:38.731562 32178 raft_consensus.cc:2454] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5da1866fb65f484086c4fa02c9722d95 in term 0.
I20260619 02:48:38.731659 32381 leader_election.cc:302] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 545d2fafca4b48778ae8906901f5cd14, 5da1866fb65f484086c4fa02c9722d95; no voters:
I20260619 02:48:38.731789 32512 raft_consensus.cc:2781] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:48:38.731844 32512 raft_consensus.cc:482] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:48:38.731874 32512 raft_consensus.cc:3037] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:38.732528 32512 raft_consensus.cc:504] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.732668 32512 leader_election.cc:288] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [CANDIDATE]: Term 1 election: Requested vote from peers f7de46fb598c4c72a9f8a426bfbf9964 (127.12.145.65:43487), 545d2fafca4b48778ae8906901f5cd14 (127.12.145.66:45619)
I20260619 02:48:38.732846 32312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0505ba0d1044c01836c3abcedd98a51" candidate_uuid: "5da1866fb65f484086c4fa02c9722d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "545d2fafca4b48778ae8906901f5cd14"
I20260619 02:48:38.732862 32178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0505ba0d1044c01836c3abcedd98a51" candidate_uuid: "5da1866fb65f484086c4fa02c9722d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7de46fb598c4c72a9f8a426bfbf9964"
I20260619 02:48:38.732949 32178 raft_consensus.cc:3037] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:38.732926 32312 raft_consensus.cc:3037] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:38.733685 32312 raft_consensus.cc:2454] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da1866fb65f484086c4fa02c9722d95 in term 1.
I20260619 02:48:38.733700 32178 raft_consensus.cc:2454] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da1866fb65f484086c4fa02c9722d95 in term 1.
I20260619 02:48:38.733844 32381 leader_election.cc:302] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 545d2fafca4b48778ae8906901f5cd14, 5da1866fb65f484086c4fa02c9722d95; no voters:
I20260619 02:48:38.733951 32512 raft_consensus.cc:2781] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:38.734118 32512 raft_consensus.cc:686] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 1 LEADER]: Becoming Leader. State: Replica: 5da1866fb65f484086c4fa02c9722d95, State: Running, Role: LEADER
I20260619 02:48:38.734215 32512 consensus_queue.cc:237] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } }
I20260619 02:48:38.735073 32032 catalog_manager.cc:5495] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5da1866fb65f484086c4fa02c9722d95 (127.12.145.67). New cstate: current_term: 1 leader_uuid: "5da1866fb65f484086c4fa02c9722d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da1866fb65f484086c4fa02c9722d95" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 33583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 } health_report { overall_health: UNKNOWN } } }
I20260619 02:48:38.747927 32505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.745412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51528 (local address 127.12.145.67:33583)
0619 02:48:38.745457 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.745459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.745468 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:38.745538 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.745539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.745563 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.745648 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:48:38.745808 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.746266 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.747108 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.747299 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.747387 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.747577 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:48:38.747678 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:48:38.747762 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.747801 (+ 39us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.747820 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260619 02:48:38.749724 32178 raft_consensus.cc:1261] T c0505ba0d1044c01836c3abcedd98a51 P f7de46fb598c4c72a9f8a426bfbf9964 [term 1 FOLLOWER]: Refusing update from remote peer 5da1866fb65f484086c4fa02c9722d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:38.750083 32312 raft_consensus.cc:1261] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 1 FOLLOWER]: Refusing update from remote peer 5da1866fb65f484086c4fa02c9722d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:38.750046 32516 consensus_queue.cc:1035] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7de46fb598c4c72a9f8a426bfbf9964" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:38.750365 32516 consensus_queue.cc:1035] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "545d2fafca4b48778ae8906901f5cd14" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 45619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:38.752511 32520 mvcc.cc:205] Tried to move back new op lower bound from 7298405657595588608 to 7298405657535713280. Current Snapshot: MvccSnapshot[applied={T|T < 7298405657595588608}]
I20260619 02:48:38.754300 32032 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:38.754400 32032 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:38.755093 32032 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bda8444933494ca08a551b31b3152d41: Sending DeleteTablet for 3 replicas of tablet c0505ba0d1044c01836c3abcedd98a51
I20260619 02:48:38.755419 32426 tablet_service.cc:1514] Processing DeleteTablet for tablet c0505ba0d1044c01836c3abcedd98a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:38 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:51522
I20260619 02:48:38.755446 32158 tablet_service.cc:1514] Processing DeleteTablet for tablet c0505ba0d1044c01836c3abcedd98a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:38 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:57036
I20260619 02:48:38.755474 32292 tablet_service.cc:1514] Processing DeleteTablet for tablet c0505ba0d1044c01836c3abcedd98a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:38 UTC) from {username='kudu', principal='kudu/127.12.145.126@KRBTEST.COM'} at 127.0.0.1:52628
I20260619 02:48:38.755713 32529 tablet_replica.cc:330] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: stopping tablet replica
I20260619 02:48:38.755714 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 32095
I20260619 02:48:38.755813 32529 raft_consensus.cc:2229] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:48:38.755904 32529 raft_consensus.cc:2258] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:38.756575 32529 ts_tablet_manager.cc:1905] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:38.758654 32529 ts_tablet_manager.cc:1918] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:38.758725 32529 log.cc:1196] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/c0505ba0d1044c01836c3abcedd98a51
I20260619 02:48:38.758976 32529 ts_tablet_manager.cc:1939] T c0505ba0d1044c01836c3abcedd98a51 P 5da1866fb65f484086c4fa02c9722d95: Deleting consensus metadata
I20260619 02:48:38.759299 32531 tablet_replica.cc:330] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: stopping tablet replica
I20260619 02:48:38.759392 32531 raft_consensus.cc:2229] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:38.759491 32531 raft_consensus.cc:2258] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:38.761238 32017 catalog_manager.cc:4841] TS 5da1866fb65f484086c4fa02c9722d95 (127.12.145.67:33583): tablet c0505ba0d1044c01836c3abcedd98a51 (table test-table [id=fc86713d45aa496b95695b6f4cf0b5c0]) successfully deleted
I20260619 02:48:38.762877 32531 ts_tablet_manager.cc:1905] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:38.764047 32531 ts_tablet_manager.cc:1918] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:38.764127 32531 log.cc:1196] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781837054956172-12869-0/minicluster-data/ts-1/wal/wals/c0505ba0d1044c01836c3abcedd98a51
I20260619 02:48:38.764379 32531 ts_tablet_manager.cc:1939] T c0505ba0d1044c01836c3abcedd98a51 P 545d2fafca4b48778ae8906901f5cd14: Deleting consensus metadata
I20260619 02:48:38.764786 32019 catalog_manager.cc:4841] TS 545d2fafca4b48778ae8906901f5cd14 (127.12.145.66:45619): tablet c0505ba0d1044c01836c3abcedd98a51 (table test-table [id=fc86713d45aa496b95695b6f4cf0b5c0]) successfully deleted
W20260619 02:48:38.765712 32017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:43487 (error 108)
I20260619 02:48:38.766007 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 32229
I20260619 02:48:38.766621 32501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.766077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:43487 (local address 127.0.0.1:57052)
0619 02:48:38.766507 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:38.766580 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:43487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404}
W20260619 02:48:38.768321 32017 catalog_manager.cc:4584] TS f7de46fb598c4c72a9f8a426bfbf9964 (127.12.145.65:43487): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0505ba0d1044c01836c3abcedd98a51: Network error: Client connection negotiation failed: client connection to 127.12.145.65:43487: connect: Connection refused (error 111)
I20260619 02:48:38.770417 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 32363
I20260619 02:48:38.776211 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 32001
2026-06-19T02:48:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2192 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-06-19T02:48:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:38Z Disabled control of system clock
I20260619 02:48:38.802968 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34035
--webserver_interface=127.12.145.126
--webserver_port=0
--builtin_ntp_servers=127.12.145.84:44169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:34035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 02:48:38.885258 32536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:38.885458 32536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:38.885478 32536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:38.886740 32536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:38.886780 32536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:38.886792 32536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:38.886806 32536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:38.886844 32536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:38.888165 32536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:34035
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:34035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:38.888407 32536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:38.888695 32536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:38.893486 32544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:38.893503 32542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:38.893471 32541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:38.893745 32536 server_base.cc:1034] running on GCE node
I20260619 02:48:38.893998 32536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:38.894277 32536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:38.895437 32536 hybrid_clock.cc:648] HybridClock initialized: now 1781837318895423 us; error 30 us; skew 500 ppm
I20260619 02:48:38.896808 32536 webserver.cc:460] Webserver started at http://127.12.145.126:38663/ using document root <none> and password file <none>
I20260619 02:48:38.897044 32536 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:38.897114 32536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:38.897249 32536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:38.898306 32536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "af1d82527c0945f28a99e349a2b6448a"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "6f160faf9773aeee8096319465ba1422"
server_key_iv: "070e0a949d32b3126826fb07c5c14c9f"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.898689 32536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "af1d82527c0945f28a99e349a2b6448a"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "6f160faf9773aeee8096319465ba1422"
server_key_iv: "070e0a949d32b3126826fb07c5c14c9f"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.899983 32536 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:48:38.900731 32550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:38.900898 32536 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:38.900996 32536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "af1d82527c0945f28a99e349a2b6448a"
format_stamp: "Formatted at 2026-06-19 02:48:38 on dist-test-slave-fbl4"
server_key: "6f160faf9773aeee8096319465ba1422"
server_key_iv: "070e0a949d32b3126826fb07c5c14c9f"
server_key_version: "encryptionkey@0"
I20260619 02:48:38.901077 32536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:38.912626 32536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:38.912909 32536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:38.913069 32536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:38.917140 32536 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:34035
I20260619 02:48:38.917171 32602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:34035 every 8 connection(s)
I20260619 02:48:38.917495 32536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:38.918457 32603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:38.920701 32603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a: Bootstrap starting.
I20260619 02:48:38.921213 32603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:38.921440 32603 log.cc:824] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:38.922067 32603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a: No bootstrap required, opened a new log
I20260619 02:48:38.923691 32603 raft_consensus.cc:348] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d82527c0945f28a99e349a2b6448a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34035 } }
I20260619 02:48:38.923825 32603 raft_consensus.cc:374] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:38.923846 32603 raft_consensus.cc:729] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af1d82527c0945f28a99e349a2b6448a, State: Initialized, Role: FOLLOWER
I20260619 02:48:38.923983 32603 consensus_queue.cc:260] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d82527c0945f28a99e349a2b6448a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34035 } }
I20260619 02:48:38.924077 32603 raft_consensus.cc:388] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:38.924108 32603 raft_consensus.cc:482] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:38.924137 32603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:38.924590 32603 raft_consensus.cc:504] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d82527c0945f28a99e349a2b6448a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34035 } }
I20260619 02:48:38.924670 32603 leader_election.cc:302] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af1d82527c0945f28a99e349a2b6448a; no voters:
I20260619 02:48:38.924784 32603 leader_election.cc:288] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:38.924863 32606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:38.925074 32603 sys_catalog.cc:564] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:38.925088 32606 raft_consensus.cc:686] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [term 1 LEADER]: Becoming Leader. State: Replica: af1d82527c0945f28a99e349a2b6448a, State: Running, Role: LEADER
I20260619 02:48:38.925284 32606 consensus_queue.cc:237] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d82527c0945f28a99e349a2b6448a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34035 } }
I20260619 02:48:38.925751 32607 sys_catalog.cc:455] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af1d82527c0945f28a99e349a2b6448a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d82527c0945f28a99e349a2b6448a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34035 } } }
I20260619 02:48:38.925835 32608 sys_catalog.cc:455] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [sys.catalog]: SysCatalogTable state changed. Reason: New leader af1d82527c0945f28a99e349a2b6448a. Latest consensus state: current_term: 1 leader_uuid: "af1d82527c0945f28a99e349a2b6448a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af1d82527c0945f28a99e349a2b6448a" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 34035 } } }
I20260619 02:48:38.925936 32608 sys_catalog.cc:458] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:38.925853 32607 sys_catalog.cc:458] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:38.926438 32615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:38.926977 32615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:38.926986 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 32536
I20260619 02:48:38.927088 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:38.927299 12869 external_mini_cluster.cc:1428] Setting key 453c2585bd5984c4aabc1bbe4f903e08
I20260619 02:48:38.928581 32615 catalog_manager.cc:1347] Generated new cluster ID: cb0869bf41dc4412b6b1d94327291133
I20260619 02:48:38.928632 32615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:38.943410 32625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:38.927759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42996 (local address 127.12.145.126:34035)
0619 02:48:38.927939 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:38.927955 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:38.937995 (+ 10040us) server_negotiation.cc:407] Connection header received
0619 02:48:38.938145 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:38.938154 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:38.938242 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:38.938403 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:38.938621 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.940071 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.941158 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:38.941808 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:38.941940 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:38.942654 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:38.942658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:38.942659 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:38.942876 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:38.942919 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:38.942934 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:38.943006 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:38.943085 (+ 79us) server_negotiation.cc:299] Negotiation successful
0619 02:48:38.943169 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260619 02:48:38.957405 32615 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:38.958125 32615 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:38.965570 32615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a: Generated new TSK 0
I20260619 02:48:38.965744 32615 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:38.970188 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.65:0
--local_ip_for_outbound_sockets=127.12.145.65
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34035
--builtin_ntp_servers=127.12.145.84:44169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 02:48:39.051702 32627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:39.051928 32627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:39.051963 32627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:39.053118 32627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:39.053184 32627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:39.053225 32627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.65
I20260619 02:48:39.054615 32627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.145.65
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.65
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:39.054874 32627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:39.055164 32627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:39.060106 32632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:39.060163 32633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:39.060175 32635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:39.060195 32627 server_base.cc:1034] running on GCE node
I20260619 02:48:39.060510 32627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:39.060777 32627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:39.061942 32627 hybrid_clock.cc:648] HybridClock initialized: now 1781837319061918 us; error 46 us; skew 500 ppm
I20260619 02:48:39.063239 32627 webserver.cc:460] Webserver started at http://127.12.145.65:37857/ using document root <none> and password file <none>
I20260619 02:48:39.063498 32627 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:39.063568 32627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:39.063727 32627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:39.064785 32627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data/instance:
uuid: "b299a08d453842a3975fc196d3ca645e"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "6df048e4c8f0cb13b387b1438d270020"
server_key_iv: "d377716aed0376c3171d59c204216e3e"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.065145 32627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance:
uuid: "b299a08d453842a3975fc196d3ca645e"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "6df048e4c8f0cb13b387b1438d270020"
server_key_iv: "d377716aed0376c3171d59c204216e3e"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.066414 32627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:39.067225 32641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.067425 32627 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:39.067523 32627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/wal
uuid: "b299a08d453842a3975fc196d3ca645e"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "6df048e4c8f0cb13b387b1438d270020"
server_key_iv: "d377716aed0376c3171d59c204216e3e"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.067610 32627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:39.094997 32627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:39.095345 32627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:39.095492 32627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:39.095711 32627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:39.096045 32627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:39.096105 32627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.096148 32627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:39.096176 32627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.102051 32627 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.65:39567
I20260619 02:48:39.102173 32754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.65:39567 every 8 connection(s)
I20260619 02:48:39.102463 32627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/data/info.pb
I20260619 02:48:39.105436 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 32627
I20260619 02:48:39.105568 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-0/wal/instance
I20260619 02:48:39.105772 12869 external_mini_cluster.cc:1428] Setting key 47da62cee2dae13999ad9b69a70d2a0a
I20260619 02:48:39.106822 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.66:0
--local_ip_for_outbound_sockets=127.12.145.66
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34035
--builtin_ntp_servers=127.12.145.84:44169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 02:48:39.108208 32625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.103251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.65:59853 (local address 127.12.145.126:34035)
0619 02:48:39.103295 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.103297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.103610 (+ 313us) server_negotiation.cc:407] Connection header received
0619 02:48:39.104037 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.104038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.104048 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.104117 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:39.104754 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.105261 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.106720 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.106969 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.107049 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.107911 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:39.107912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:39.107913 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:39.107917 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:39.107930 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:39.107935 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:39.108004 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.108101 (+ 97us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.108131 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:48:39.108419 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.103223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34035 (local address 127.12.145.65:59853)
0619 02:48:39.103423 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.103464 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.103946 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.104176 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.104180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.104188 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:39.104685 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.104689 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.105363 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.105365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.106642 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.106646 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.107060 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.107061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.107202 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.107771 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:39.107772 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:39.107799 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:39.107822 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:39.108006 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:39.108012 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:39.108015 (+ 3us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.108101 (+ 86us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.108202 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260619 02:48:39.108830 32755 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34035
I20260619 02:48:39.108914 32755 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:39.109110 32755 heartbeater.cc:511] Master 127.12.145.126:34035 requested a full tablet report, sending...
I20260619 02:48:39.109611 32567 ts_manager.cc:194] Registered new tserver with Master: b299a08d453842a3975fc196d3ca645e (127.12.145.65:39567)
I20260619 02:48:39.110225 32567 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.65:59853
W20260619 02:48:39.187919 32758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:39.188155 32758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:39.188191 32758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:39.189313 32758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:39.189375 32758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:39.189417 32758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.66
I20260619 02:48:39.190755 32758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.145.66
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.66
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:39.191005 32758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:39.191294 32758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:39.196108 32764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:39.196115 32766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:39.196115 32763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:39.196331 32758 server_base.cc:1034] running on GCE node
I20260619 02:48:39.196512 32758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:39.196729 32758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:39.197889 32758 hybrid_clock.cc:648] HybridClock initialized: now 1781837319197871 us; error 50 us; skew 500 ppm
I20260619 02:48:39.199154 32758 webserver.cc:460] Webserver started at http://127.12.145.66:46051/ using document root <none> and password file <none>
I20260619 02:48:39.199386 32758 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:39.199438 32758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:39.199599 32758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:39.200639 32758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data/instance:
uuid: "4ea3fe42bcd642efbabf4789333f6388"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "223bc0e8acf016a269bf26792e6c4af0"
server_key_iv: "7ac544f0c90d06efb9b733cb13d2f235"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.200994 32758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance:
uuid: "4ea3fe42bcd642efbabf4789333f6388"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "223bc0e8acf016a269bf26792e6c4af0"
server_key_iv: "7ac544f0c90d06efb9b733cb13d2f235"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.202287 32758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:48:39.203063 304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.203249 32758 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.203336 32758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/wal
uuid: "4ea3fe42bcd642efbabf4789333f6388"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "223bc0e8acf016a269bf26792e6c4af0"
server_key_iv: "7ac544f0c90d06efb9b733cb13d2f235"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.203402 32758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:39.218065 32758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:39.218339 32758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:39.218490 32758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:39.218729 32758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:39.219062 32758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:39.219095 32758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.219136 32758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:39.219164 32758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.224777 32758 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.66:43681
I20260619 02:48:39.224838 417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.66:43681 every 8 connection(s)
I20260619 02:48:39.225203 32758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/data/info.pb
I20260619 02:48:39.230089 32625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.225906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:51211 (local address 127.12.145.126:34035)
0619 02:48:39.225980 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.225982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.226255 (+ 273us) server_negotiation.cc:407] Connection header received
0619 02:48:39.226767 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.226768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.226778 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.226833 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:39.227522 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.228001 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.228970 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.229143 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.229193 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.229873 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:39.229874 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:39.229874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:39.229879 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:39.229892 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:39.229896 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:39.229941 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.230007 (+ 66us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.230030 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:48:39.230345 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.225934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34035 (local address 127.12.145.66:51211)
0619 02:48:39.226132 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.226164 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.226678 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.226882 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.226885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.226893 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:39.227412 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.227417 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.228133 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.228133 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.228898 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.228900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.229212 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.229212 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.229313 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.229754 (+ 441us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:39.229754 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:39.229780 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:39.229801 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:39.229944 (+ 143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:39.229946 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:39.229948 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.229992 (+ 44us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.230090 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":118,"threads_started":1}
I20260619 02:48:39.230872 418 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34035
I20260619 02:48:39.230960 418 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:39.231154 418 heartbeater.cc:511] Master 127.12.145.126:34035 requested a full tablet report, sending...
I20260619 02:48:39.231526 32567 ts_manager.cc:194] Registered new tserver with Master: 4ea3fe42bcd642efbabf4789333f6388 (127.12.145.66:43681)
I20260619 02:48:39.231886 32567 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.66:51211
I20260619 02:48:39.232014 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 32758
I20260619 02:48:39.232165 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-1/wal/instance
I20260619 02:48:39.232391 12869 external_mini_cluster.cc:1428] Setting key 0811eac286da3c8843950c53044660da
I20260619 02:48:39.233276 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.145.67:0
--local_ip_for_outbound_sockets=127.12.145.67
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34035
--builtin_ntp_servers=127.12.145.84:44169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 02:48:39.313151 421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:39.313349 421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:39.313370 421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:39.314469 421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:39.314502 421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:39.314527 421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.145.67
I20260619 02:48:39.315907 421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:44169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.145.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.145.67
--webserver_port=0
--tserver_master_addrs=127.12.145.126:34035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.145.67
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:39.316165 421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:39.316468 421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:39.321308 429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:39.321321 426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:39.321324 427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:39.321620 421 server_base.cc:1034] running on GCE node
I20260619 02:48:39.321856 421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:39.322095 421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:39.323253 421 hybrid_clock.cc:648] HybridClock initialized: now 1781837319323244 us; error 29 us; skew 500 ppm
I20260619 02:48:39.324615 421 webserver.cc:460] Webserver started at http://127.12.145.67:35441/ using document root <none> and password file <none>
I20260619 02:48:39.324882 421 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:39.324951 421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:39.325106 421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:39.326256 421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data/instance:
uuid: "f7440044bac84b4d9b863de5bedce391"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "a97370013c3769b7bd09a2d5149e9259"
server_key_iv: "d77f1f042c48fce5fe4d0e52e16c2bde"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.326678 421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance:
uuid: "f7440044bac84b4d9b863de5bedce391"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "a97370013c3769b7bd09a2d5149e9259"
server_key_iv: "d77f1f042c48fce5fe4d0e52e16c2bde"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.327948 421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:39.328662 435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.328845 421 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:39.328940 421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal
uuid: "f7440044bac84b4d9b863de5bedce391"
format_stamp: "Formatted at 2026-06-19 02:48:39 on dist-test-slave-fbl4"
server_key: "a97370013c3769b7bd09a2d5149e9259"
server_key_iv: "d77f1f042c48fce5fe4d0e52e16c2bde"
server_key_version: "encryptionkey@0"
I20260619 02:48:39.329025 421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:39.344209 421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:39.344528 421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:39.344689 421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:39.344914 421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 02:48:39.345243 421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 02:48:39.345296 421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.345337 421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 02:48:39.345366 421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:39.351107 421 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.67:39269
I20260619 02:48:39.351162 548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.67:39269 every 8 connection(s)
I20260619 02:48:39.351526 421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/data/info.pb
I20260619 02:48:39.356555 32625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.352254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.67:35807 (local address 127.12.145.126:34035)
0619 02:48:39.352339 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.352342 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.352536 (+ 194us) server_negotiation.cc:407] Connection header received
0619 02:48:39.353058 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.353059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.353090 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.353142 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:39.353785 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.354289 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.355347 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.355535 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.355593 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.356324 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:39.356325 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:39.356326 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:39.356330 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:39.356343 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:39.356347 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:39.356389 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.356472 (+ 83us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.356495 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260619 02:48:39.356773 551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.352219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:34035 (local address 127.12.145.67:35807)
0619 02:48:39.352410 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.352444 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.352947 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.353199 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.353202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.353210 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:48:39.353714 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.353718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.354392 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.354393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.355267 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.355269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.355609 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.355610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.355716 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.356192 (+ 476us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 02:48:39.356192 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:48:39.356220 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 02:48:39.356249 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:48:39.356401 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:48:39.356405 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:48:39.356407 (+ 2us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.356459 (+ 52us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.356533 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260619 02:48:39.357298 549 heartbeater.cc:347] Connected to a master server at 127.12.145.126:34035
I20260619 02:48:39.357398 549 heartbeater.cc:464] Registering TS with master...
I20260619 02:48:39.357580 549 heartbeater.cc:511] Master 127.12.145.126:34035 requested a full tablet report, sending...
I20260619 02:48:39.357930 32567 ts_manager.cc:194] Registered new tserver with Master: f7440044bac84b4d9b863de5bedce391 (127.12.145.67:39269)
I20260619 02:48:39.358023 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 421
I20260619 02:48:39.358126 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal/instance
I20260619 02:48:39.358325 12869 external_mini_cluster.cc:1428] Setting key 83595a2b161d439d972388ff3eb4b873
I20260619 02:48:39.358378 32567 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.145.67:35807
I20260619 02:48:39.359238 12869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 02:48:39.363504 32625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.360515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43006 (local address 127.12.145.126:34035)
0619 02:48:39.360601 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.360604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.360727 (+ 123us) server_negotiation.cc:407] Connection header received
0619 02:48:39.360796 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.360797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.360809 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.360864 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:39.361044 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.361500 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.362280 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.362484 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.362577 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.363280 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:39.363281 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:39.363282 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:39.363287 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:39.363299 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:39.363303 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:39.363356 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.363409 (+ 53us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.363431 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260619 02:48:39.365023 32567 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 02:48:39.366539 32567 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 02:48:39.373261 559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.368781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:39269 (local address 127.0.0.1:34216)
0619 02:48:39.369229 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.369238 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.369289 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.369486 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.369489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.369492 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:39.369632 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.369635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.371033 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.371034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.372039 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.372042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.372952 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.372953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.373047 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.373061 (+ 14us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.373109 (+ 48us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.373163 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":5,"thread_start_us":106,"threads_started":1}
I20260619 02:48:39.373289 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.369160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56164 (local address 127.12.145.66:43681)
0619 02:48:39.369693 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.369698 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.369707 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:39.369743 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.369745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.369760 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.369827 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:39.370016 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.371215 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.372385 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.372866 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.372966 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.373072 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.373153 (+ 81us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.373191 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":82,"threads_started":1}
I20260619 02:48:39.373442 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.369053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32938 (local address 127.12.145.65:39567)
0619 02:48:39.369384 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.369390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.369401 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:48:39.369442 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.369444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.369459 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.369577 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:39.369714 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.370805 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.372215 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.372888 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.372951 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.373067 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.373301 (+ 234us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.373350 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":78,"threads_started":1}
I20260619 02:48:39.373695 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.368783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:43681 (local address 127.0.0.1:56164)
0619 02:48:39.369377 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.369385 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.369421 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.369893 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.369893 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.369895 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:39.369927 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.369929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.371300 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.371301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.372305 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.372306 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.372968 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.372969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.373063 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.373068 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.373139 (+ 71us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.373184 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":3,"thread_start_us":57,"threads_started":1}
I20260619 02:48:39.373729 560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.368951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34216 (local address 127.12.145.67:39269)
0619 02:48:39.369225 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.369230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.369280 (+ 50us) server_negotiation.cc:407] Connection header received
0619 02:48:39.369368 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.369370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.369382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.369476 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:39.369721 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.370925 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.372117 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.372847 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.373470 (+ 623us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.373571 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.373594 (+ 23us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.373631 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":87,"threads_started":1}
I20260619 02:48:39.373893 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.368779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:39567 (local address 127.0.0.1:32938)
0619 02:48:39.369130 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.369174 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.369243 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.369576 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.369577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.369578 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:39.369630 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.369632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.370893 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.370894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.372119 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.372122 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.373101 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.373102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.373152 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.373156 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.373203 (+ 47us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.373237 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":112,"threads_started":1}
I20260619 02:48:39.374496 483 tablet_service.cc:1467] Processing CreateTablet for tablet c850b416c4284565a1d75701366a76e9 (DEFAULT_TABLE table=test-table [id=0c8a7050fcc743e2ad3c516dc4f68ca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:39.374586 352 tablet_service.cc:1467] Processing CreateTablet for tablet c850b416c4284565a1d75701366a76e9 (DEFAULT_TABLE table=test-table [id=0c8a7050fcc743e2ad3c516dc4f68ca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:39.374581 32689 tablet_service.cc:1467] Processing CreateTablet for tablet c850b416c4284565a1d75701366a76e9 (DEFAULT_TABLE table=test-table [id=0c8a7050fcc743e2ad3c516dc4f68ca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 02:48:39.374920 483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c850b416c4284565a1d75701366a76e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:39.374922 32689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c850b416c4284565a1d75701366a76e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:39.374922 352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c850b416c4284565a1d75701366a76e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:39.377564 563 tablet_bootstrap.cc:492] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Bootstrap starting.
I20260619 02:48:39.378134 564 tablet_bootstrap.cc:492] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: Bootstrap starting.
I20260619 02:48:39.378268 563 tablet_bootstrap.cc:654] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:39.378651 563 log.cc:824] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:39.378685 565 tablet_bootstrap.cc:492] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: Bootstrap starting.
I20260619 02:48:39.378825 564 tablet_bootstrap.cc:654] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:39.379173 564 log.cc:824] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:39.379385 565 tablet_bootstrap.cc:654] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:39.379469 563 tablet_bootstrap.cc:492] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: No bootstrap required, opened a new log
I20260619 02:48:39.379552 563 ts_tablet_manager.cc:1397] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260619 02:48:39.379704 565 log.cc:824] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:39.379971 564 tablet_bootstrap.cc:492] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: No bootstrap required, opened a new log
I20260619 02:48:39.380043 564 ts_tablet_manager.cc:1397] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:39.380484 565 tablet_bootstrap.cc:492] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: No bootstrap required, opened a new log
I20260619 02:48:39.380569 565 ts_tablet_manager.cc:1397] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260619 02:48:39.382279 565 raft_consensus.cc:348] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.382277 563 raft_consensus.cc:348] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.382429 563 raft_consensus.cc:374] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:39.382434 565 raft_consensus.cc:374] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:39.382462 563 raft_consensus.cc:729] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7440044bac84b4d9b863de5bedce391, State: Initialized, Role: FOLLOWER
I20260619 02:48:39.382478 565 raft_consensus.cc:729] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea3fe42bcd642efbabf4789333f6388, State: Initialized, Role: FOLLOWER
I20260619 02:48:39.382534 564 raft_consensus.cc:348] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.382639 563 consensus_queue.cc:260] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.382632 565 consensus_queue.cc:260] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.382704 564 raft_consensus.cc:374] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:39.382741 564 raft_consensus.cc:729] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b299a08d453842a3975fc196d3ca645e, State: Initialized, Role: FOLLOWER
I20260619 02:48:39.382886 563 ts_tablet_manager.cc:1428] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260619 02:48:39.382889 565 ts_tablet_manager.cc:1428] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 02:48:39.382884 564 consensus_queue.cc:260] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.383000 549 heartbeater.cc:503] Master 127.12.145.126:34035 was elected leader, sending a full tablet report...
I20260619 02:48:39.383037 418 heartbeater.cc:503] Master 127.12.145.126:34035 was elected leader, sending a full tablet report...
I20260619 02:48:39.383383 564 ts_tablet_manager.cc:1428] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 02:48:39.383500 32755 heartbeater.cc:503] Master 127.12.145.126:34035 was elected leader, sending a full tablet report...
I20260619 02:48:39.387836 570 raft_consensus.cc:482] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 02:48:39.387900 570 raft_consensus.cc:504] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.388221 570 leader_election.cc:288] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b299a08d453842a3975fc196d3ca645e (127.12.145.65:39567), f7440044bac84b4d9b863de5bedce391 (127.12.145.67:39269)
I20260619 02:48:39.391925 560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.388435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:57895 (local address 127.12.145.67:39269)
0619 02:48:39.388555 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.388557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.388639 (+ 82us) server_negotiation.cc:407] Connection header received
0619 02:48:39.388664 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.388665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.388674 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.388741 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:39.388871 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.389603 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.391041 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.391564 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.391632 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.391639 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.391821 (+ 182us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.391854 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260619 02:48:39.391925 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.388434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.145.66:50721 (local address 127.12.145.65:39567)
0619 02:48:39.388578 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.388580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.388587 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:48:39.388629 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.388629 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.388640 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.388693 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 02:48:39.388871 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.389611 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.391041 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.391560 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.391632 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.391639 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.391821 (+ 182us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.391855 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260619 02:48:39.391948 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.388387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:39567 (local address 127.12.145.66:50721)
0619 02:48:39.388445 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.388456 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.388506 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.388711 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.388712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.388731 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:39.388802 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.388804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.389682 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.389683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.390951 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.390954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.391641 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.391642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.391739 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.391744 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.391802 (+ 58us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.391853 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":77}
I20260619 02:48:39.391963 572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.388387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.67:39269 (local address 127.12.145.66:57895)
0619 02:48:39.388562 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.388571 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:48:39.388628 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:48:39.388740 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:48:39.388740 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:48:39.388741 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 02:48:39.388802 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.388804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.389682 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.389683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.390953 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:48:39.390954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.391642 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.391643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:48:39.391739 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.391744 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 02:48:39.391802 (+ 58us) client_negotiation.cc:240] Negotiation successful
0619 02:48:39.391852 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":63,"thread_start_us":103,"threads_started":1}
I20260619 02:48:39.392261 503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c850b416c4284565a1d75701366a76e9" candidate_uuid: "4ea3fe42bcd642efbabf4789333f6388" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7440044bac84b4d9b863de5bedce391" is_pre_election: true
I20260619 02:48:39.392319 32709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c850b416c4284565a1d75701366a76e9" candidate_uuid: "4ea3fe42bcd642efbabf4789333f6388" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b299a08d453842a3975fc196d3ca645e" is_pre_election: true
I20260619 02:48:39.392383 503 raft_consensus.cc:2454] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea3fe42bcd642efbabf4789333f6388 in term 0.
I20260619 02:48:39.392432 32709 raft_consensus.cc:2454] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea3fe42bcd642efbabf4789333f6388 in term 0.
I20260619 02:48:39.392573 308 leader_election.cc:302] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ea3fe42bcd642efbabf4789333f6388, f7440044bac84b4d9b863de5bedce391; no voters:
I20260619 02:48:39.392702 570 raft_consensus.cc:2781] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 02:48:39.392748 570 raft_consensus.cc:482] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 02:48:39.392764 570 raft_consensus.cc:3037] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:39.393369 570 raft_consensus.cc:504] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.393553 570 leader_election.cc:288] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [CANDIDATE]: Term 1 election: Requested vote from peers b299a08d453842a3975fc196d3ca645e (127.12.145.65:39567), f7440044bac84b4d9b863de5bedce391 (127.12.145.67:39269)
I20260619 02:48:39.393620 32709 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c850b416c4284565a1d75701366a76e9" candidate_uuid: "4ea3fe42bcd642efbabf4789333f6388" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b299a08d453842a3975fc196d3ca645e"
I20260619 02:48:39.393680 32709 raft_consensus.cc:3037] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:39.393697 503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c850b416c4284565a1d75701366a76e9" candidate_uuid: "4ea3fe42bcd642efbabf4789333f6388" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7440044bac84b4d9b863de5bedce391"
I20260619 02:48:39.393761 503 raft_consensus.cc:3037] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:39.394254 32709 raft_consensus.cc:2454] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea3fe42bcd642efbabf4789333f6388 in term 1.
I20260619 02:48:39.394378 503 raft_consensus.cc:2454] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea3fe42bcd642efbabf4789333f6388 in term 1.
I20260619 02:48:39.394439 306 leader_election.cc:302] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ea3fe42bcd642efbabf4789333f6388, b299a08d453842a3975fc196d3ca645e; no voters:
I20260619 02:48:39.394521 570 raft_consensus.cc:2781] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:39.394663 570 raft_consensus.cc:686] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 1 LEADER]: Becoming Leader. State: Replica: 4ea3fe42bcd642efbabf4789333f6388, State: Running, Role: LEADER
I20260619 02:48:39.394757 570 consensus_queue.cc:237] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } }
I20260619 02:48:39.395421 32565 catalog_manager.cc:5495] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ea3fe42bcd642efbabf4789333f6388 (127.12.145.66). New cstate: current_term: 1 leader_uuid: "4ea3fe42bcd642efbabf4789333f6388" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ea3fe42bcd642efbabf4789333f6388" member_type: VOTER last_known_addr { host: "127.12.145.66" port: 43681 } health_report { overall_health: HEALTHY } } }
I20260619 02:48:39.407735 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.405433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56174 (local address 127.12.145.66:43681)
0619 02:48:39.405477 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:39.405480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:39.405490 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:48:39.405551 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:39.405552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:39.405565 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:39.405619 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:48:39.405707 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.406231 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.407042 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:39.407270 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:39.407324 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:39.407466 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:48:39.407547 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:48:39.407601 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:39.407615 (+ 14us) server_negotiation.cc:299] Negotiation successful
0619 02:48:39.407628 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:48:39.409273 32709 raft_consensus.cc:1261] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 1 FOLLOWER]: Refusing update from remote peer 4ea3fe42bcd642efbabf4789333f6388: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:39.409278 503 raft_consensus.cc:1261] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 1 FOLLOWER]: Refusing update from remote peer 4ea3fe42bcd642efbabf4789333f6388: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:48:39.409610 573 consensus_queue.cc:1035] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b299a08d453842a3975fc196d3ca645e" member_type: VOTER last_known_addr { host: "127.12.145.65" port: 39567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:39.409754 570 consensus_queue.cc:1035] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7440044bac84b4d9b863de5bedce391" member_type: VOTER last_known_addr { host: "127.12.145.67" port: 39269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:48:39.413734 577 mvcc.cc:205] Tried to move back new op lower bound from 7298405660298158080 to 7298405660241494016. Current Snapshot: MvccSnapshot[applied={T|T < 7298405660298158080 or (T in {7298405660298158080})}]
I20260619 02:48:39.413945 32567 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:39.414038 32567 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 02:48:39.414801 32567 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af1d82527c0945f28a99e349a2b6448a: Sending DeleteTablet for 3 replicas of tablet c850b416c4284565a1d75701366a76e9
I20260619 02:48:39.415117 483 tablet_service.cc:1514] Processing DeleteTablet for tablet c850b416c4284565a1d75701366a76e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:39 UTC) from {username='slave'} at 127.0.0.1:34216
I20260619 02:48:39.415189 352 tablet_service.cc:1514] Processing DeleteTablet for tablet c850b416c4284565a1d75701366a76e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:39 UTC) from {username='slave'} at 127.0.0.1:56164
I20260619 02:48:39.415195 32689 tablet_service.cc:1514] Processing DeleteTablet for tablet c850b416c4284565a1d75701366a76e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 02:48:39 UTC) from {username='slave'} at 127.0.0.1:32938
I20260619 02:48:39.415373 586 tablet_replica.cc:330] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: stopping tablet replica
I20260619 02:48:39.415454 586 raft_consensus.cc:2229] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 1 LEADER]: Raft consensus shutting down.
I20260619 02:48:39.415454 587 tablet_replica.cc:330] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: stopping tablet replica
I20260619 02:48:39.415535 586 raft_consensus.cc:2258] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:39.415544 587 raft_consensus.cc:2229] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:39.415633 587 raft_consensus.cc:2258] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:39.415781 585 tablet_replica.cc:330] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: stopping tablet replica
I20260619 02:48:39.415812 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 32627
I20260619 02:48:39.415867 585 raft_consensus.cc:2229] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 02:48:39.415956 585 raft_consensus.cc:2258] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 02:48:39.416193 587 ts_tablet_manager.cc:1905] T c850b416c4284565a1d75701366a76e9 P b299a08d453842a3975fc196d3ca645e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:39.416649 585 ts_tablet_manager.cc:1905] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:39.418115 585 ts_tablet_manager.cc:1918] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 02:48:39.418213 585 log.cc:1196] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Deleting WAL directory at /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781837054956172-12869-0/minicluster-data/ts-2/wal/wals/c850b416c4284565a1d75701366a76e9
I20260619 02:48:39.418442 585 ts_tablet_manager.cc:1939] T c850b416c4284565a1d75701366a76e9 P f7440044bac84b4d9b863de5bedce391: Deleting consensus metadata
I20260619 02:48:39.418848 32554 catalog_manager.cc:4841] TS f7440044bac84b4d9b863de5bedce391 (127.12.145.67:39269): tablet c850b416c4284565a1d75701366a76e9 (table test-table [id=0c8a7050fcc743e2ad3c516dc4f68ca2]) successfully deleted
W20260619 02:48:39.421989 32552 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.145.65:39567 (error 108)
I20260619 02:48:39.422278 586 ts_tablet_manager.cc:1905] T c850b416c4284565a1d75701366a76e9 P 4ea3fe42bcd642efbabf4789333f6388: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 02:48:39.422456 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.422339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.65:39567 (local address 127.0.0.1:32950)
0619 02:48:39.422385 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.422422 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.65:39567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260619 02:48:39.422585 32552 catalog_manager.cc:4584] TS b299a08d453842a3975fc196d3ca645e (127.12.145.65:39567): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c850b416c4284565a1d75701366a76e9: Network error: Client connection negotiation failed: client connection to 127.12.145.65:39567: connect: Connection refused (error 111)
I20260619 02:48:39.422971 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 32758
I20260619 02:48:39.427758 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 421
I20260619 02:48:39.427927 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:39.427827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.66:43681 (local address 127.0.0.1:56184)
0619 02:48:39.427871 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0619 02:48:39.427894 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.66:43681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260619 02:48:39.432014 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 32536
2026-06-19T02:48:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (654 ms)
[----------] 6 tests from EncryptionPolicyTest (8264 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:39 dist-test-slave-fbl4 krb5kdc[591](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:39 dist-test-slave-fbl4 krb5kdc[591](info): set up 2 sockets
Jun 19 02:48:39 dist-test-slave-fbl4 krb5kdc[591](info): commencing operation
krb5kdc: starting...
W20260619 02:48:40.478718 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:40 dist-test-slave-fbl4 krb5kdc[591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:40.593528 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:40.673275 604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:40.673484 604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:40.673516 604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:40.674696 604 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:40.674738 604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:40.674753 604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:40.674765 604 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:40.674777 604 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:40.676218 604 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:40.676472 604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:40.676702 604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:40.681629 609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:40.681658 610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:40.681694 612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:40.681916 604 server_base.cc:1034] running on GCE node
I20260619 02:48:40.682179 604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:40.682425 604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:40.683588 604 hybrid_clock.cc:648] HybridClock initialized: now 1781837320683584 us; error 54 us; skew 500 ppm
Jun 19 02:48:40 dist-test-slave-fbl4 krb5kdc[591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837320, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:40.686148 604 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:40.686659 604 webserver.cc:460] Webserver started at http://127.0.0.1:38649/ using document root <none> and password file <none>
I20260619 02:48:40.686846 604 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:40.686887 604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:40.686973 604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:40.688033 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "1b06a1498ead4d5a949411552d62bedd"
format_stamp: "Formatted at 2026-06-19 02:48:40 on dist-test-slave-fbl4"
server_key: "a05f011e888fd6365a460581e70120e7"
server_key_iv: "1f1c1ba31145075a359d71acfeb8e5b2"
server_key_version: "encryptionkey@0"
I20260619 02:48:40.688334 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "1b06a1498ead4d5a949411552d62bedd"
format_stamp: "Formatted at 2026-06-19 02:48:40 on dist-test-slave-fbl4"
server_key: "a05f011e888fd6365a460581e70120e7"
server_key_iv: "1f1c1ba31145075a359d71acfeb8e5b2"
server_key_version: "encryptionkey@0"
I20260619 02:48:40.689554 604 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:40.690251 619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:40.690423 604 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:40.690492 604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "1b06a1498ead4d5a949411552d62bedd"
format_stamp: "Formatted at 2026-06-19 02:48:40 on dist-test-slave-fbl4"
server_key: "a05f011e888fd6365a460581e70120e7"
server_key_iv: "1f1c1ba31145075a359d71acfeb8e5b2"
server_key_version: "encryptionkey@0"
I20260619 02:48:40.690590 604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:40.707744 604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:40.709558 604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:40.709664 604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:40.713796 604 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44981
I20260619 02:48:40.713874 671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44981 every 8 connection(s)
I20260619 02:48:40.714207 604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:40.715225 672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:40.717443 672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd: Bootstrap starting.
I20260619 02:48:40.718014 672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:40.718199 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 604
I20260619 02:48:40.718318 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:40.718333 672 log.cc:824] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:40.718508 12869 external_mini_cluster.cc:1428] Setting key 8a752b34a2a5fc1c706c2fabcd2b0acd
I20260619 02:48:40.719201 672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd: No bootstrap required, opened a new log
I20260619 02:48:40.721848 672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b06a1498ead4d5a949411552d62bedd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44981 } }
I20260619 02:48:40.722029 672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:40.722065 672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b06a1498ead4d5a949411552d62bedd, State: Initialized, Role: FOLLOWER
I20260619 02:48:40.722180 672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b06a1498ead4d5a949411552d62bedd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44981 } }
I20260619 02:48:40.722249 672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:40.722276 672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:40.722317 672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:40.722947 672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b06a1498ead4d5a949411552d62bedd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44981 } }
I20260619 02:48:40.723050 672 leader_election.cc:302] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b06a1498ead4d5a949411552d62bedd; no voters:
I20260619 02:48:40.723250 672 leader_election.cc:288] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:40.723268 677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:40.723380 677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [term 1 LEADER]: Becoming Leader. State: Replica: 1b06a1498ead4d5a949411552d62bedd, State: Running, Role: LEADER
I20260619 02:48:40.723461 677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b06a1498ead4d5a949411552d62bedd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44981 } }
I20260619 02:48:40.723501 672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:40.723796 677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b06a1498ead4d5a949411552d62bedd. Latest consensus state: current_term: 1 leader_uuid: "1b06a1498ead4d5a949411552d62bedd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b06a1498ead4d5a949411552d62bedd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44981 } } }
I20260619 02:48:40.723871 677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:40.723807 678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b06a1498ead4d5a949411552d62bedd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b06a1498ead4d5a949411552d62bedd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44981 } } }
I20260619 02:48:40.724076 678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd [sys.catalog]: This master's current role is: LEADER
W20260619 02:48:40.725387 692 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
Jun 19 02:48:40 dist-test-slave-fbl4 krb5kdc[591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837320, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
W20260619 02:48:40.725471 692 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:48:40.725518 682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:40.725703 682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:40.727316 682 catalog_manager.cc:1347] Generated new cluster ID: 2a457873be1b49b5961863715d4b143d
I20260619 02:48:40.727367 682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:40.729383 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:40.719123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43905 (local address 127.0.0.1:44981)
0619 02:48:40.719286 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:40.719296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:40.719328 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:48:40.719763 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:40.719769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:40.719813 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:40.719919 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:40.720701 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:40.721528 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:40.722610 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:40.723050 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:40.723158 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:40.726026 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:40.726030 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:40.726031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:40.726042 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:40.727885 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:40.728263 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:40.728266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:40.728267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:40.728358 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:40.728588 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:40.728589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:40.728590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:40.728833 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:40.729024 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:40.729106 (+ 82us) server_negotiation.cc:299] Negotiation successful
0619 02:48:40.729206 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260619 02:48:40.730440 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:40.737699 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:40.731849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55989 (local address 127.0.0.1:44981)
0619 02:48:40.731884 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:40.731886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:40.731895 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:40.731939 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:40.731940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:40.731949 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:40.731995 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:40.732483 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:40.732987 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:40.733671 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:40.733896 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:40.733980 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:40.735158 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:40.735159 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:40.735160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:40.735167 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:40.736535 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:40.736901 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:40.736902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:40.736902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:40.736954 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:40.737203 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:40.737204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:40.737204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:40.737311 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:40.737419 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:40.737540 (+ 121us) server_negotiation.cc:299] Negotiation successful
0619 02:48:40.737610 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:48:40.742947 682 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:40.743427 682 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:40.745417 682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b06a1498ead4d5a949411552d62bedd: Generated new TSK 0
I20260619 02:48:40.745615 682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:40.748680 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 604
W20260619 02:48:40.753186 589 connection.cc:535] client connection to 127.0.0.1:44981 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44981): Connection reset by peer (error 104)
2026-06-19T02:48:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1315 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:40 dist-test-slave-fbl4 krb5kdc[703](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:40 dist-test-slave-fbl4 krb5kdc[703](info): set up 2 sockets
Jun 19 02:48:40 dist-test-slave-fbl4 krb5kdc[703](info): commencing operation
krb5kdc: starting...
W20260619 02:48:41.782699 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:41 dist-test-slave-fbl4 krb5kdc[703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:41.898658 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40277
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:41.977725 716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:41.977955 716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:41.977994 716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:41.979195 716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:41.979277 716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:41.979323 716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:41.979355 716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:41.979380 716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:41.980811 716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40277
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:41.981086 716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:41.981310 716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:41.986123 722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:41.986163 724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:41.986099 721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:41.986318 716 server_base.cc:1034] running on GCE node
I20260619 02:48:41.986596 716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:41.986929 716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:41.988132 716 hybrid_clock.cc:648] HybridClock initialized: now 1781837321988120 us; error 48 us; skew 500 ppm
Jun 19 02:48:41 dist-test-slave-fbl4 krb5kdc[703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837321, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:41.998201 716 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:41.998709 716 webserver.cc:460] Webserver started at http://127.0.0.1:46067/ using document root <none> and password file <none>
I20260619 02:48:41.998908 716 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:41.998956 716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:41.999044 716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:42.000033 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "10a4a31df79c45d58b2a9d72e1f16cd1"
format_stamp: "Formatted at 2026-06-19 02:48:41 on dist-test-slave-fbl4"
server_key: "b71253f87aa507406553e88e163874e1"
server_key_iv: "10fea4b01f23312900899edc39f4b82e"
server_key_version: "encryptionkey@0"
I20260619 02:48:42.000334 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "10a4a31df79c45d58b2a9d72e1f16cd1"
format_stamp: "Formatted at 2026-06-19 02:48:41 on dist-test-slave-fbl4"
server_key: "b71253f87aa507406553e88e163874e1"
server_key_iv: "10fea4b01f23312900899edc39f4b82e"
server_key_version: "encryptionkey@0"
I20260619 02:48:42.001557 716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:42.002262 731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:42.002494 716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:42.002643 716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "10a4a31df79c45d58b2a9d72e1f16cd1"
format_stamp: "Formatted at 2026-06-19 02:48:41 on dist-test-slave-fbl4"
server_key: "b71253f87aa507406553e88e163874e1"
server_key_iv: "10fea4b01f23312900899edc39f4b82e"
server_key_version: "encryptionkey@0"
I20260619 02:48:42.002737 716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:42.014183 716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:42.017010 716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:42.017189 716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:42.021636 716 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40277
I20260619 02:48:42.021664 783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40277 every 8 connection(s)
I20260619 02:48:42.022009 716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:42.022769 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 716
I20260619 02:48:42.022891 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:42.022985 784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:42.023137 12869 external_mini_cluster.cc:1428] Setting key 9d3879d2508f2d6a4f79c2a43c125ecb
I20260619 02:48:42.026752 784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1: Bootstrap starting.
I20260619 02:48:42.027407 784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:42.027726 784 log.cc:824] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:42.028600 784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1: No bootstrap required, opened a new log
I20260619 02:48:42.029325 787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:42.023687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40537 (local address 127.0.0.1:40277)
0619 02:48:42.023859 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:42.023870 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:42.023902 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:48:42.024454 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:42.024464 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:42.024526 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:42.024687 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:42.024848 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:42.026191 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:42.027117 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:42.027754 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:42.027858 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:42.028639 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:42.028644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:42.028644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:42.028851 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:42.028889 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:42.028904 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:42.028993 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:42.029078 (+ 85us) server_negotiation.cc:299] Negotiation successful
0619 02:48:42.029109 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260619 02:48:42.030449 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:42.030886 784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40277 } }
I20260619 02:48:42.031070 784 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:42.031107 784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a4a31df79c45d58b2a9d72e1f16cd1, State: Initialized, Role: FOLLOWER
I20260619 02:48:42.031236 784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40277 } }
I20260619 02:48:42.031313 784 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:42.031343 784 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:42.031387 784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:42.032176 784 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40277 } }
I20260619 02:48:42.032297 784 leader_election.cc:302] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10a4a31df79c45d58b2a9d72e1f16cd1; no voters:
I20260619 02:48:42.032459 784 leader_election.cc:288] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:42.032516 794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:42.032667 794 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [term 1 LEADER]: Becoming Leader. State: Replica: 10a4a31df79c45d58b2a9d72e1f16cd1, State: Running, Role: LEADER
I20260619 02:48:42.032722 784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:42.032755 794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40277 } }
I20260619 02:48:42.033097 794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10a4a31df79c45d58b2a9d72e1f16cd1. Latest consensus state: current_term: 1 leader_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40277 } } }
I20260619 02:48:42.033175 794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:42.033108 796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a4a31df79c45d58b2a9d72e1f16cd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40277 } } }
I20260619 02:48:42.033370 796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:42.033398 800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:42.033982 800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:42.035583 800 catalog_manager.cc:1347] Generated new cluster ID: e464623940fe4b0c844c368554e0efb5
I20260619 02:48:42.035635 800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:42.035737 787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:42.031983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41533 (local address 127.0.0.1:40277)
0619 02:48:42.032043 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:42.032045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:42.032167 (+ 122us) server_negotiation.cc:407] Connection header received
0619 02:48:42.032226 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:42.032227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:42.032234 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:42.032308 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:42.032495 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:42.033215 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:42.034266 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:42.034511 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:42.034643 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:42.035334 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:42.035336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:42.035336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:42.035341 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:42.035354 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:42.035358 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:42.035411 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:42.035619 (+ 208us) server_negotiation.cc:299] Negotiation successful
0619 02:48:42.035628 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:48:42.043061 800 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:42.043789 800 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:42.061635 800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10a4a31df79c45d58b2a9d72e1f16cd1: Generated new TSK 0
I20260619 02:48:42.061863 800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:42.067924 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 716
W20260619 02:48:42.072325 701 connection.cc:535] client connection to 127.0.0.1:40277 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40277): Connection reset by peer (error 104)
2026-06-19T02:48:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1319 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:42 dist-test-slave-fbl4 krb5kdc[815](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:42 dist-test-slave-fbl4 krb5kdc[815](info): set up 2 sockets
Jun 19 02:48:42 dist-test-slave-fbl4 krb5kdc[815](info): commencing operation
krb5kdc: starting...
W20260619 02:48:43.110747 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:43 dist-test-slave-fbl4 krb5kdc[815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:43.229429 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43197
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:43.310709 828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:43.310905 828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:43.310927 828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:43.311991 828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:43.312031 828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:43.312047 828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:43.312058 828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:43.312070 828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:43.313454 828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43197
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:43.313697 828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:43.313941 828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:43.318758 837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:43.318818 835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:43.318761 834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:43.319028 828 server_base.cc:1034] running on GCE node
I20260619 02:48:43.319274 828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:43.319613 828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:43.320801 828 hybrid_clock.cc:648] HybridClock initialized: now 1781837323320779 us; error 39 us; skew 500 ppm
Jun 19 02:48:43 dist-test-slave-fbl4 krb5kdc[815](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837323, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:43.323438 828 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:43.323904 828 webserver.cc:460] Webserver started at http://127.0.0.1:44953/ using document root <none> and password file <none>
I20260619 02:48:43.324127 828 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:43.324194 828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:43.324345 828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:43.325392 828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "dd6716daccd04d3589cc85b643ee63db"
format_stamp: "Formatted at 2026-06-19 02:48:43 on dist-test-slave-fbl4"
server_key: "61cc85f72e881c6d63c9cbac9db21710"
server_key_iv: "a1cc033f201080cc83f323500bb5c064"
server_key_version: "encryptionkey@0"
I20260619 02:48:43.325754 828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "dd6716daccd04d3589cc85b643ee63db"
format_stamp: "Formatted at 2026-06-19 02:48:43 on dist-test-slave-fbl4"
server_key: "61cc85f72e881c6d63c9cbac9db21710"
server_key_iv: "a1cc033f201080cc83f323500bb5c064"
server_key_version: "encryptionkey@0"
I20260619 02:48:43.327158 828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:43.327873 844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:43.328044 828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:43.328145 828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "dd6716daccd04d3589cc85b643ee63db"
format_stamp: "Formatted at 2026-06-19 02:48:43 on dist-test-slave-fbl4"
server_key: "61cc85f72e881c6d63c9cbac9db21710"
server_key_iv: "a1cc033f201080cc83f323500bb5c064"
server_key_version: "encryptionkey@0"
I20260619 02:48:43.328214 828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:43.331494 828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:43.333352 828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:43.333504 828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:43.337510 828 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43197
I20260619 02:48:43.337556 896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43197 every 8 connection(s)
I20260619 02:48:43.337880 828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:43.338968 897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:43.341200 897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db: Bootstrap starting.
I20260619 02:48:43.341794 897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:43.342080 897 log.cc:824] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:43.342787 897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db: No bootstrap required, opened a new log
I20260619 02:48:43.344060 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 828
I20260619 02:48:43.344151 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:43.344352 12869 external_mini_cluster.cc:1428] Setting key 4be6afdd04a2364749e3e186b7983d3a
I20260619 02:48:43.344563 897 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6716daccd04d3589cc85b643ee63db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43197 } }
I20260619 02:48:43.344735 897 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:43.344781 897 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd6716daccd04d3589cc85b643ee63db, State: Initialized, Role: FOLLOWER
I20260619 02:48:43.344913 897 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6716daccd04d3589cc85b643ee63db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43197 } }
I20260619 02:48:43.345001 897 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:43.345043 897 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:43.345093 897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:43.346228 897 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6716daccd04d3589cc85b643ee63db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43197 } }
I20260619 02:48:43.346349 897 leader_election.cc:302] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd6716daccd04d3589cc85b643ee63db; no voters:
I20260619 02:48:43.346525 897 leader_election.cc:288] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:43.346581 902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:43.346635 901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:43.344846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57487 (local address 127.0.0.1:43197)
0619 02:48:43.345075 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:43.345085 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:43.345122 (+ 37us) server_negotiation.cc:407] Connection header received
0619 02:48:43.345272 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:43.345278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:43.345302 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:43.345402 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:43.346086 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:43.346089 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:43.346089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:43.346093 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:43.346128 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:43.346139 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:43.346193 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:43.346295 (+ 102us) server_negotiation.cc:299] Negotiation successful
0619 02:48:43.346358 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":108,"threads_started":1}
I20260619 02:48:43.346693 902 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [term 1 LEADER]: Becoming Leader. State: Replica: dd6716daccd04d3589cc85b643ee63db, State: Running, Role: LEADER
I20260619 02:48:43.346800 897 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:43.346773 902 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6716daccd04d3589cc85b643ee63db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43197 } }
I20260619 02:48:43.347113 902 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd6716daccd04d3589cc85b643ee63db. Latest consensus state: current_term: 1 leader_uuid: "dd6716daccd04d3589cc85b643ee63db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6716daccd04d3589cc85b643ee63db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43197 } } }
I20260619 02:48:43.347219 902 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:43.347424 908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:43.347886 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:43.348021 908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:43.347106 903 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd6716daccd04d3589cc85b643ee63db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd6716daccd04d3589cc85b643ee63db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43197 } } }
I20260619 02:48:43.348455 903 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:43.349923 908 catalog_manager.cc:1347] Generated new cluster ID: 7dc789ecd4cc43c1bd7c8a150826dc57
I20260619 02:48:43.349977 908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:43.351076 901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:43.349633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56283 (local address 127.0.0.1:43197)
0619 02:48:43.349672 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:43.349674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:43.350136 (+ 462us) server_negotiation.cc:407] Connection header received
0619 02:48:43.350167 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:43.350168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:43.350172 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:43.350242 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:43.350834 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:43.350835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:43.350835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:43.350839 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:43.350854 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:43.350858 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:43.350923 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:43.350994 (+ 71us) server_negotiation.cc:299] Negotiation successful
0619 02:48:43.351007 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:48:43.363054 908 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:43.363219 908 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:43.373656 908 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd6716daccd04d3589cc85b643ee63db: Generated new TSK 0
I20260619 02:48:43.373855 908 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:43.383487 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 828
2026-06-19T02:48:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1314 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:43 dist-test-slave-fbl4 krb5kdc[928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:43 dist-test-slave-fbl4 krb5kdc[928](info): set up 2 sockets
Jun 19 02:48:43 dist-test-slave-fbl4 krb5kdc[928](info): commencing operation
krb5kdc: starting...
W20260619 02:48:44.414752 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:44 dist-test-slave-fbl4 krb5kdc[928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:44.530762 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45805
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:44.608839 941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:44.609057 941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:44.609081 941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:44.610249 941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:44.610289 941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:44.610303 941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:44.610345 941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:44.610373 941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:44.611840 941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:44.612103 941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:44.612360 941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:44.617154 949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:44.617193 947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:44.617221 946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:44.617261 941 server_base.cc:1034] running on GCE node
I20260619 02:48:44.617511 941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:44.617805 941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:44.618963 941 hybrid_clock.cc:648] HybridClock initialized: now 1781837324618950 us; error 27 us; skew 500 ppm
Jun 19 02:48:44 dist-test-slave-fbl4 krb5kdc[928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837324, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:44.621340 941 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:44.621781 941 webserver.cc:460] Webserver started at http://127.0.0.1:35295/ using document root <none> and password file <none>
I20260619 02:48:44.621958 941 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:44.621995 941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:44.622089 941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:44.623190 941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "9a84e443fe19461c9eef5055d80a6245"
format_stamp: "Formatted at 2026-06-19 02:48:44 on dist-test-slave-fbl4"
server_key: "e496ae6e16c4a048b07803b458d11227"
server_key_iv: "c28f09a0fb377792d551661464305b17"
server_key_version: "encryptionkey@0"
I20260619 02:48:44.623489 941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "9a84e443fe19461c9eef5055d80a6245"
format_stamp: "Formatted at 2026-06-19 02:48:44 on dist-test-slave-fbl4"
server_key: "e496ae6e16c4a048b07803b458d11227"
server_key_iv: "c28f09a0fb377792d551661464305b17"
server_key_version: "encryptionkey@0"
I20260619 02:48:44.624783 941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:48:44.625444 956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:44.625645 941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:44.625718 941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "9a84e443fe19461c9eef5055d80a6245"
format_stamp: "Formatted at 2026-06-19 02:48:44 on dist-test-slave-fbl4"
server_key: "e496ae6e16c4a048b07803b458d11227"
server_key_iv: "c28f09a0fb377792d551661464305b17"
server_key_version: "encryptionkey@0"
I20260619 02:48:44.625771 941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:44.641652 941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:44.643499 941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:44.643623 941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:44.647761 941 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45805
I20260619 02:48:44.647847 1008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45805 every 8 connection(s)
I20260619 02:48:44.648145 941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:44.648998 1009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:44.651226 1009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245: Bootstrap starting.
I20260619 02:48:44.651743 1009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:44.651964 1009 log.cc:824] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:44.652689 1009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245: No bootstrap required, opened a new log
I20260619 02:48:44.654218 1009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a84e443fe19461c9eef5055d80a6245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45805 } }
I20260619 02:48:44.654350 1009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:44.654371 1009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a84e443fe19461c9eef5055d80a6245, State: Initialized, Role: FOLLOWER
I20260619 02:48:44.654467 1009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a84e443fe19461c9eef5055d80a6245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45805 } }
I20260619 02:48:44.654546 1009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:44.654605 1009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:44.654663 1009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:44.654976 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 941
I20260619 02:48:44.655105 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:44.655287 1009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a84e443fe19461c9eef5055d80a6245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45805 } }
I20260619 02:48:44.655331 12869 external_mini_cluster.cc:1428] Setting key cebc84443cee8a629a52299e72fb380d
I20260619 02:48:44.655397 1009 leader_election.cc:302] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a84e443fe19461c9eef5055d80a6245; no voters:
I20260619 02:48:44.655568 1009 leader_election.cc:288] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:44.655611 1012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:44.655778 1012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [term 1 LEADER]: Becoming Leader. State: Replica: 9a84e443fe19461c9eef5055d80a6245, State: Running, Role: LEADER
I20260619 02:48:44.655812 1009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:44.655884 1012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a84e443fe19461c9eef5055d80a6245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45805 } }
I20260619 02:48:44.656262 1012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a84e443fe19461c9eef5055d80a6245. Latest consensus state: current_term: 1 leader_uuid: "9a84e443fe19461c9eef5055d80a6245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a84e443fe19461c9eef5055d80a6245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45805 } } }
I20260619 02:48:44.656356 1012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:44.656745 1013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a84e443fe19461c9eef5055d80a6245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a84e443fe19461c9eef5055d80a6245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45805 } } }
I20260619 02:48:44.656816 1013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:44.656962 1019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:44.657469 1019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:44.658989 1019 catalog_manager.cc:1347] Generated new cluster ID: 12e8d4c1f5724f41925b6d11c0034c47
I20260619 02:48:44.659040 1019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:48:44 dist-test-slave-fbl4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 02:48:44.668026 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:44.656002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51207 (local address 127.0.0.1:45805)
0619 02:48:44.656613 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:44.656623 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:44.656662 (+ 39us) server_negotiation.cc:407] Connection header received
0619 02:48:44.656783 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:44.656790 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:44.656847 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:44.656993 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:44.657904 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:44.659328 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:44.660402 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:44.661037 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:44.661157 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:44.663861 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:44.663865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:44.663865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:44.663876 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:44.666366 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:44.666797 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:44.666800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:44.666800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:44.666898 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:44.667109 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:44.667110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:44.667111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:44.667380 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:44.667541 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:44.667664 (+ 123us) server_negotiation.cc:299] Negotiation successful
0619 02:48:44.667791 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":76,"threads_started":1}
I20260619 02:48:44.668341 1019 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:44.669016 1019 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:44.669059 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:44.671309 1019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a84e443fe19461c9eef5055d80a6245: Generated new TSK 0
I20260619 02:48:44.671481 1019 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:44.676766 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:44.670497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37639 (local address 127.0.0.1:45805)
0619 02:48:44.670530 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:44.670532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:44.670615 (+ 83us) server_negotiation.cc:407] Connection header received
0619 02:48:44.670687 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:44.670688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:44.670698 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:44.670755 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:44.671388 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:44.672125 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:44.672800 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:44.673148 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:44.673217 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:44.674248 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:44.674249 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:44.674249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:44.674256 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:44.675770 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:44.676095 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:44.676097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:44.676097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:44.676153 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:44.676322 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:44.676322 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:44.676323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:44.676442 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:44.676535 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:44.676608 (+ 73us) server_negotiation.cc:299] Negotiation successful
0619 02:48:44.676681 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:48:44.678613 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 941
2026-06-19T02:48:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:44 dist-test-slave-fbl4 krb5kdc[1040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:44 dist-test-slave-fbl4 krb5kdc[1040](info): set up 2 sockets
Jun 19 02:48:44 dist-test-slave-fbl4 krb5kdc[1040](info): commencing operation
krb5kdc: starting...
W20260619 02:48:45.722772 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:45 dist-test-slave-fbl4 krb5kdc[1040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:45.839604 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34775
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:45.921155 1053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:45.921419 1053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:45.921455 1053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:45.922634 1053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:45.922699 1053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:45.922724 1053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:45.922745 1053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:45.922785 1053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:45.924243 1053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:45.924513 1053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:45.924742 1053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:45.929628 1061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:45.929633 1059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:45.929652 1053 server_base.cc:1034] running on GCE node
W20260619 02:48:45.929648 1058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:45.930018 1053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:45.930307 1053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:45.931448 1053 hybrid_clock.cc:648] HybridClock initialized: now 1781837325931398 us; error 66 us; skew 500 ppm
Jun 19 02:48:45 dist-test-slave-fbl4 krb5kdc[1040](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837325, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:45.933846 1053 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:45.934283 1053 webserver.cc:460] Webserver started at http://127.0.0.1:34189/ using document root <none> and password file <none>
I20260619 02:48:45.934481 1053 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:45.934520 1053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:45.934688 1053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:45.935695 1053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "7490254c7b8a4fadb894c10e6cc33d3b"
format_stamp: "Formatted at 2026-06-19 02:48:45 on dist-test-slave-fbl4"
server_key: "2b8121aae117816e7bb1ee9649542166"
server_key_iv: "b3134cd9461987a069a07361377ea76f"
server_key_version: "encryptionkey@0"
I20260619 02:48:45.935981 1053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "7490254c7b8a4fadb894c10e6cc33d3b"
format_stamp: "Formatted at 2026-06-19 02:48:45 on dist-test-slave-fbl4"
server_key: "2b8121aae117816e7bb1ee9649542166"
server_key_iv: "b3134cd9461987a069a07361377ea76f"
server_key_version: "encryptionkey@0"
I20260619 02:48:45.937263 1053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:48:45.937950 1068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:45.938135 1053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:45.938239 1053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "7490254c7b8a4fadb894c10e6cc33d3b"
format_stamp: "Formatted at 2026-06-19 02:48:45 on dist-test-slave-fbl4"
server_key: "2b8121aae117816e7bb1ee9649542166"
server_key_iv: "b3134cd9461987a069a07361377ea76f"
server_key_version: "encryptionkey@0"
I20260619 02:48:45.938313 1053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:45.958027 1053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:45.960116 1053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:45.960281 1053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:45.964324 1053 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34775
I20260619 02:48:45.964377 1120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34775 every 8 connection(s)
I20260619 02:48:45.964746 1053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:45.965610 1121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:45.967983 1121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b: Bootstrap starting.
I20260619 02:48:45.968508 1121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:45.968734 1121 log.cc:824] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:45.969396 1121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b: No bootstrap required, opened a new log
I20260619 02:48:45.971046 1121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34775 } }
I20260619 02:48:45.971179 1121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:45.971200 1121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7490254c7b8a4fadb894c10e6cc33d3b, State: Initialized, Role: FOLLOWER
I20260619 02:48:45.971331 1121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34775 } }
I20260619 02:48:45.971410 1121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:45.971431 1121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:45.971459 1121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:45.971912 1121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34775 } }
I20260619 02:48:45.972002 1121 leader_election.cc:302] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7490254c7b8a4fadb894c10e6cc33d3b; no voters:
I20260619 02:48:45.972113 1121 leader_election.cc:288] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:45.972177 1124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:45.972361 1124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7490254c7b8a4fadb894c10e6cc33d3b, State: Running, Role: LEADER
I20260619 02:48:45.972406 1121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:45.972447 1124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34775 } }
I20260619 02:48:45.972887 1126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7490254c7b8a4fadb894c10e6cc33d3b. Latest consensus state: current_term: 1 leader_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34775 } } }
I20260619 02:48:45.972983 1126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:45.973019 1125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7490254c7b8a4fadb894c10e6cc33d3b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34775 } } }
I20260619 02:48:45.973115 1125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:45.973819 1133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:45.974354 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1053
I20260619 02:48:45.974500 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:45.974712 12869 external_mini_cluster.cc:1428] Setting key 01ab0b80cb3dab44519bc4bc637e0b4c
I20260619 02:48:45.974383 1133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:45.976504 1133 catalog_manager.cc:1347] Generated new cluster ID: 49065cd4c1c54122a96b8420ef930b4d
I20260619 02:48:45.976555 1133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:45.990418 1133 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:45.991110 1133 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:45.992419 1143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:45.975157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43333 (local address 127.0.0.1:34775)
0619 02:48:45.975340 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:45.975349 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:45.986850 (+ 11501us) server_negotiation.cc:407] Connection header received
0619 02:48:45.986997 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:45.987005 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:45.987066 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:45.987210 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:45.987449 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:45.988899 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:45.989990 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:45.990785 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:45.990897 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:45.991625 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:45.991629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:45.991629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:45.991839 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:45.991882 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:45.991897 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:45.991967 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:45.992039 (+ 72us) server_negotiation.cc:299] Negotiation successful
0619 02:48:45.992215 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260619 02:48:45.993278 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:45.998164 1143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:45.994730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39915 (local address 127.0.0.1:34775)
0619 02:48:45.994764 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:45.994766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:45.994944 (+ 178us) server_negotiation.cc:407] Connection header received
0619 02:48:45.994969 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:45.994970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:45.994980 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:45.995043 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:45.995134 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:45.995892 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:45.996908 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:45.997216 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:45.997286 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:45.997933 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:45.997935 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:45.997935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:45.997940 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:45.997953 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:45.997958 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:45.998015 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:45.998066 (+ 51us) server_negotiation.cc:299] Negotiation successful
0619 02:48:45.998092 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:48:46.000604 1133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7490254c7b8a4fadb894c10e6cc33d3b: Generated new TSK 0
I20260619 02:48:46.000782 1133 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:46.003633 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1053
2026-06-19T02:48:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1325 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:46 dist-test-slave-fbl4 krb5kdc[1152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:46 dist-test-slave-fbl4 krb5kdc[1152](info): set up 2 sockets
Jun 19 02:48:46 dist-test-slave-fbl4 krb5kdc[1152](info): commencing operation
krb5kdc: starting...
W20260619 02:48:47.034937 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:47 dist-test-slave-fbl4 krb5kdc[1152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837327, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:47.153851 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35491
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:47.234030 1165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:47.234236 1165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:47.234258 1165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:47.235419 1165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:47.235459 1165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:47.235474 1165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:47.235486 1165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:47.235498 1165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:47.236923 1165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:47.237175 1165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:47.237417 1165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:47.242190 1171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:47.242278 1165 server_base.cc:1034] running on GCE node
W20260619 02:48:47.242195 1170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:47.242195 1173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:47.242718 1165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:47.243003 1165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:47.244158 1165 hybrid_clock.cc:648] HybridClock initialized: now 1781837327244135 us; error 40 us; skew 500 ppm
Jun 19 02:48:47 dist-test-slave-fbl4 krb5kdc[1152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837327, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:47.250249 1165 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:47.250746 1165 webserver.cc:460] Webserver started at http://127.0.0.1:46549/ using document root <none> and password file <none>
I20260619 02:48:47.250973 1165 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:47.251048 1165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:47.251192 1165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:47.252272 1165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "483e7f711f9e4696bd26261d1b680440"
format_stamp: "Formatted at 2026-06-19 02:48:47 on dist-test-slave-fbl4"
server_key: "43c32584a71dad70c307b8967b7a7f2e"
server_key_iv: "e35a4dddb72c661ce8249989ee8cc6b8"
server_key_version: "encryptionkey@0"
I20260619 02:48:47.252645 1165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "483e7f711f9e4696bd26261d1b680440"
format_stamp: "Formatted at 2026-06-19 02:48:47 on dist-test-slave-fbl4"
server_key: "43c32584a71dad70c307b8967b7a7f2e"
server_key_iv: "e35a4dddb72c661ce8249989ee8cc6b8"
server_key_version: "encryptionkey@0"
I20260619 02:48:47.253983 1165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:47.254773 1180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:47.254935 1165 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:48:47.255086 1165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "483e7f711f9e4696bd26261d1b680440"
format_stamp: "Formatted at 2026-06-19 02:48:47 on dist-test-slave-fbl4"
server_key: "43c32584a71dad70c307b8967b7a7f2e"
server_key_iv: "e35a4dddb72c661ce8249989ee8cc6b8"
server_key_version: "encryptionkey@0"
I20260619 02:48:47.255227 1165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:47.258581 1165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:47.260483 1165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:47.260644 1165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:47.264575 1165 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35491
I20260619 02:48:47.264603 1232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35491 every 8 connection(s)
I20260619 02:48:47.264923 1165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:47.265772 1233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:47.267993 1233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440: Bootstrap starting.
I20260619 02:48:47.268517 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1165
I20260619 02:48:47.268564 1233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:47.268673 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:47.268869 12869 external_mini_cluster.cc:1428] Setting key 69e90fae8d37875ae92d92bc51505504
I20260619 02:48:47.268863 1233 log.cc:824] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:47.269630 1233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440: No bootstrap required, opened a new log
I20260619 02:48:47.271312 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:47.269378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60529 (local address 127.0.0.1:35491)
0619 02:48:47.269562 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:47.269573 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:47.269604 (+ 31us) server_negotiation.cc:407] Connection header received
0619 02:48:47.270054 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:47.270061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:47.270086 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:47.270226 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:47.270892 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:47.270895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:47.270896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:47.270900 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:47.270951 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:47.270961 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:47.271054 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:47.271108 (+ 54us) server_negotiation.cc:299] Negotiation successful
0619 02:48:47.271148 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260619 02:48:47.272241 1233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483e7f711f9e4696bd26261d1b680440" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35491 } }
I20260619 02:48:47.272418 1233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:47.272450 1233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483e7f711f9e4696bd26261d1b680440, State: Initialized, Role: FOLLOWER
I20260619 02:48:47.272473 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:47.272550 1233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483e7f711f9e4696bd26261d1b680440" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35491 } }
I20260619 02:48:47.272626 1233 raft_consensus.cc:388] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:47.272653 1233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:47.272680 1233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:47.273159 1233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483e7f711f9e4696bd26261d1b680440" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35491 } }
I20260619 02:48:47.273231 1233 leader_election.cc:302] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 483e7f711f9e4696bd26261d1b680440; no voters:
I20260619 02:48:47.273370 1233 leader_election.cc:288] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:47.273391 1239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:47.273500 1239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [term 1 LEADER]: Becoming Leader. State: Replica: 483e7f711f9e4696bd26261d1b680440, State: Running, Role: LEADER
I20260619 02:48:47.273568 1239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483e7f711f9e4696bd26261d1b680440" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35491 } }
I20260619 02:48:47.273602 1233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:47.273870 1239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 483e7f711f9e4696bd26261d1b680440. Latest consensus state: current_term: 1 leader_uuid: "483e7f711f9e4696bd26261d1b680440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483e7f711f9e4696bd26261d1b680440" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35491 } } }
I20260619 02:48:47.273900 1241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "483e7f711f9e4696bd26261d1b680440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483e7f711f9e4696bd26261d1b680440" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35491 } } }
I20260619 02:48:47.273976 1239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:47.274034 1241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440 [sys.catalog]: This master's current role is: LEADER
W20260619 02:48:47.275710 1259 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260619 02:48:47.275807 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:47.274069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39635 (local address 127.0.0.1:35491)
0619 02:48:47.274107 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:47.274109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:47.274702 (+ 593us) server_negotiation.cc:407] Connection header received
0619 02:48:47.274830 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:47.274831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:47.274836 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:47.274866 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:47.275504 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:47.275505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:47.275506 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:47.275510 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:47.275524 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:47.275529 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:47.275602 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:47.275689 (+ 87us) server_negotiation.cc:299] Negotiation successful
0619 02:48:47.275702 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260619 02:48:47.275815 1259 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:48:47.275887 1248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:47.276211 1248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:47.277588 1248 catalog_manager.cc:1347] Generated new cluster ID: 1243175725e04b07886c8147f2740d68
I20260619 02:48:47.277637 1248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:47.293637 1248 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:47.293826 1248 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:47.297037 1248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 483e7f711f9e4696bd26261d1b680440: Generated new TSK 0
I20260619 02:48:47.297243 1248 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:47.300799 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1165
2026-06-19T02:48:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1296 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:47 dist-test-slave-fbl4 krb5kdc[1264](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:47 dist-test-slave-fbl4 krb5kdc[1264](info): set up 2 sockets
Jun 19 02:48:47 dist-test-slave-fbl4 krb5kdc[1264](info): commencing operation
krb5kdc: starting...
W20260619 02:48:48.346756 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:48 dist-test-slave-fbl4 krb5kdc[1264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:48.461774 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33241
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:48.540339 1277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:48.540580 1277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:48.540618 1277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:48.541785 1277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:48.541850 1277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:48.541874 1277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:48.541901 1277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:48.541932 1277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:48.543555 1277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:48.543846 1277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:48.544077 1277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:48.548883 1285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:48.548923 1282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:48.548933 1283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:48.549104 1277 server_base.cc:1034] running on GCE node
I20260619 02:48:48.549353 1277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:48.549669 1277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:48.550829 1277 hybrid_clock.cc:648] HybridClock initialized: now 1781837328550817 us; error 30 us; skew 500 ppm
Jun 19 02:48:48 dist-test-slave-fbl4 krb5kdc[1264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837328, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:48.553326 1277 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:48.553764 1277 webserver.cc:460] Webserver started at http://127.0.0.1:38845/ using document root <none> and password file <none>
I20260619 02:48:48.553985 1277 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:48.554030 1277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:48.554201 1277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:48.555684 1277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "176eebbc252344bd92ae29f8a74cc20f"
format_stamp: "Formatted at 2026-06-19 02:48:48 on dist-test-slave-fbl4"
server_key: "a91fc7047d3f7cfc368c7b5dffaef3a6"
server_key_iv: "77ddc94c308005c24af01e2c695e127f"
server_key_version: "encryptionkey@0"
I20260619 02:48:48.556041 1277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "176eebbc252344bd92ae29f8a74cc20f"
format_stamp: "Formatted at 2026-06-19 02:48:48 on dist-test-slave-fbl4"
server_key: "a91fc7047d3f7cfc368c7b5dffaef3a6"
server_key_iv: "77ddc94c308005c24af01e2c695e127f"
server_key_version: "encryptionkey@0"
I20260619 02:48:48.557335 1277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:48.558077 1292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:48.558275 1277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:48.558374 1277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "176eebbc252344bd92ae29f8a74cc20f"
format_stamp: "Formatted at 2026-06-19 02:48:48 on dist-test-slave-fbl4"
server_key: "a91fc7047d3f7cfc368c7b5dffaef3a6"
server_key_iv: "77ddc94c308005c24af01e2c695e127f"
server_key_version: "encryptionkey@0"
I20260619 02:48:48.558460 1277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:48.574506 1277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:48.576503 1277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:48.576673 1277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:48.580767 1277 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33241
I20260619 02:48:48.580801 1344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33241 every 8 connection(s)
I20260619 02:48:48.581167 1277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:48.582048 1345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:48.584327 1345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f: Bootstrap starting.
I20260619 02:48:48.584899 1345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:48.585180 1345 log.cc:824] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:48.585868 1345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f: No bootstrap required, opened a new log
I20260619 02:48:48.586078 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1277
I20260619 02:48:48.586191 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:48.586357 12869 external_mini_cluster.cc:1428] Setting key 8335ed2e571556d61ca65177d584d98c
I20260619 02:48:48.587981 1345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176eebbc252344bd92ae29f8a74cc20f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33241 } }
I20260619 02:48:48.588137 1345 raft_consensus.cc:374] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:48.588176 1345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176eebbc252344bd92ae29f8a74cc20f, State: Initialized, Role: FOLLOWER
I20260619 02:48:48.588369 1345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176eebbc252344bd92ae29f8a74cc20f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33241 } }
I20260619 02:48:48.588464 1345 raft_consensus.cc:388] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:48.588510 1345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:48.588564 1345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:48.589512 1345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176eebbc252344bd92ae29f8a74cc20f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33241 } }
I20260619 02:48:48.589632 1345 leader_election.cc:302] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 176eebbc252344bd92ae29f8a74cc20f; no voters:
I20260619 02:48:48.589797 1345 leader_election.cc:288] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:48.589839 1350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:48.590016 1350 raft_consensus.cc:686] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [term 1 LEADER]: Becoming Leader. State: Replica: 176eebbc252344bd92ae29f8a74cc20f, State: Running, Role: LEADER
I20260619 02:48:48.590041 1345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:48.590185 1350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176eebbc252344bd92ae29f8a74cc20f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33241 } }
I20260619 02:48:48.591440 1351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "176eebbc252344bd92ae29f8a74cc20f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176eebbc252344bd92ae29f8a74cc20f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33241 } } }
I20260619 02:48:48.591545 1352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 176eebbc252344bd92ae29f8a74cc20f. Latest consensus state: current_term: 1 leader_uuid: "176eebbc252344bd92ae29f8a74cc20f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176eebbc252344bd92ae29f8a74cc20f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33241 } } }
I20260619 02:48:48.591625 1351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:48.591868 1352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f [sys.catalog]: This master's current role is: LEADER
W20260619 02:48:48.591922 1365 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:48:48.591984 1365 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:48:48.592146 1367 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:48.592319 1367 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:48.593930 1367 catalog_manager.cc:1347] Generated new cluster ID: a75d0954b5dd48fd9870a171d7cd60e7
I20260619 02:48:48.593978 1367 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:48:48 dist-test-slave-fbl4 krb5kdc[1264](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 02:48:48.598567 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:48.586890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:49191 (local address 127.0.0.1:33241)
0619 02:48:48.587064 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:48.587073 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:48.587109 (+ 36us) server_negotiation.cc:407] Connection header received
0619 02:48:48.587966 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:48.587972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:48.588020 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:48.588161 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:48.588942 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:48.589967 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:48.591197 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:48.591897 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:48.592003 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:48.594943 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:48.594947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:48.594947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:48.594957 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:48.596832 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:48.597291 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:48.597293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:48.597294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:48.597412 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:48.597655 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:48.597655 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:48.597656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:48.597929 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:48.598090 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:48.598239 (+ 149us) server_negotiation.cc:299] Negotiation successful
0619 02:48:48.598332 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260619 02:48:48.599466 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:48.603422 1367 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:48.604122 1367 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:48.610170 1349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:48.600829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:37171 (local address 127.0.0.1:33241)
0619 02:48:48.600860 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:48.600862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:48.603112 (+ 2250us) server_negotiation.cc:407] Connection header received
0619 02:48:48.603370 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:48.603371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:48.603383 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:48.603445 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:48.604038 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:48.604780 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:48.605735 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:48.606078 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:48.606148 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:48.607431 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:48.607433 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:48.607433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:48.607439 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:48.608988 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:48.609387 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:48.609388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:48.609388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:48.609445 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:48.609669 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:48.609670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:48.609670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:48.609795 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:48.609906 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:48.610018 (+ 112us) server_negotiation.cc:299] Negotiation successful
0619 02:48:48.610081 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260619 02:48:48.617489 1367 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 176eebbc252344bd92ae29f8a74cc20f: Generated new TSK 0
I20260619 02:48:48.617678 1367 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:48.624617 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1277
W20260619 02:48:48.628911 1262 connection.cc:535] client connection to 127.0.0.1:33241 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33241): Connection reset by peer (error 104)
2026-06-19T02:48:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1324 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:48 dist-test-slave-fbl4 krb5kdc[1376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:48 dist-test-slave-fbl4 krb5kdc[1376](info): set up 2 sockets
Jun 19 02:48:48 dist-test-slave-fbl4 krb5kdc[1376](info): commencing operation
krb5kdc: starting...
W20260619 02:48:49.658795 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:49 dist-test-slave-fbl4 krb5kdc[1376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:49.773587 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39433
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:49.851626 1389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:49.851886 1389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:49.851920 1389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:49.853057 1389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:49.853129 1389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:49.853154 1389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:49.853183 1389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:49.853214 1389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:49.854660 1389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:49.854921 1389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:49.855141 1389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:49.859767 1395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:49.859782 1397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:49.859774 1394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:49.859978 1389 server_base.cc:1034] running on GCE node
I20260619 02:48:49.860225 1389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:49.860477 1389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:49.861624 1389 hybrid_clock.cc:648] HybridClock initialized: now 1781837329861610 us; error 28 us; skew 500 ppm
Jun 19 02:48:49 dist-test-slave-fbl4 krb5kdc[1376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837329, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:49.864071 1389 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:49.864465 1389 webserver.cc:460] Webserver started at http://127.0.0.1:44785/ using document root <none> and password file <none>
I20260619 02:48:49.864689 1389 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:49.864755 1389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:49.864902 1389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:49.865963 1389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "0f224983b554416eb06d1517c00bab25"
format_stamp: "Formatted at 2026-06-19 02:48:49 on dist-test-slave-fbl4"
server_key: "455eee3e7b7b453d179e63eadda182ed"
server_key_iv: "242a2a7c7b61c046b5a6eb298d455e9b"
server_key_version: "encryptionkey@0"
I20260619 02:48:49.866320 1389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "0f224983b554416eb06d1517c00bab25"
format_stamp: "Formatted at 2026-06-19 02:48:49 on dist-test-slave-fbl4"
server_key: "455eee3e7b7b453d179e63eadda182ed"
server_key_iv: "242a2a7c7b61c046b5a6eb298d455e9b"
server_key_version: "encryptionkey@0"
I20260619 02:48:49.867664 1389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:49.868381 1404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:49.868590 1389 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:49.868696 1389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "0f224983b554416eb06d1517c00bab25"
format_stamp: "Formatted at 2026-06-19 02:48:49 on dist-test-slave-fbl4"
server_key: "455eee3e7b7b453d179e63eadda182ed"
server_key_iv: "242a2a7c7b61c046b5a6eb298d455e9b"
server_key_version: "encryptionkey@0"
I20260619 02:48:49.868790 1389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:49.879024 1389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:49.881306 1389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:49.881474 1389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:49.885238 1389 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39433
I20260619 02:48:49.885268 1456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39433 every 8 connection(s)
I20260619 02:48:49.885613 1389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:49.886471 1457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:49.887645 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1389
I20260619 02:48:49.887809 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:49.888028 12869 external_mini_cluster.cc:1428] Setting key 6f74c41451516f173db449c0f78ba8c7
I20260619 02:48:49.889207 1457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25: Bootstrap starting.
I20260619 02:48:49.889889 1457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:49.890189 1457 log.cc:824] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:49.890908 1457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25: No bootstrap required, opened a new log
I20260619 02:48:49.893009 1457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f224983b554416eb06d1517c00bab25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260619 02:48:49.893138 1457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:49.893160 1457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f224983b554416eb06d1517c00bab25, State: Initialized, Role: FOLLOWER
I20260619 02:48:49.893303 1457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f224983b554416eb06d1517c00bab25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260619 02:48:49.893362 1457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:49.893383 1457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:49.893446 1457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:49.893947 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:49.888556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:58473 (local address 127.0.0.1:39433)
0619 02:48:49.888741 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:49.888750 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:49.888786 (+ 36us) server_negotiation.cc:407] Connection header received
0619 02:48:49.889350 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:49.889359 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:49.889419 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:49.889575 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:49.889730 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:49.891066 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:49.891830 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:49.892476 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:49.892609 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:49.893302 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:49.893306 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:49.893306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:49.893526 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:49.893566 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:49.893578 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:49.893668 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:49.893749 (+ 81us) server_negotiation.cc:299] Negotiation successful
0619 02:48:49.893777 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
I20260619 02:48:49.894085 1457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f224983b554416eb06d1517c00bab25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260619 02:48:49.894192 1457 leader_election.cc:302] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f224983b554416eb06d1517c00bab25; no voters:
I20260619 02:48:49.894341 1457 leader_election.cc:288] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:49.894383 1462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:49.894573 1462 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [term 1 LEADER]: Becoming Leader. State: Replica: 0f224983b554416eb06d1517c00bab25, State: Running, Role: LEADER
I20260619 02:48:49.894621 1457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:49.894726 1462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f224983b554416eb06d1517c00bab25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260619 02:48:49.895272 1464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f224983b554416eb06d1517c00bab25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f224983b554416eb06d1517c00bab25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } } }
I20260619 02:48:49.895282 1463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f224983b554416eb06d1517c00bab25. Latest consensus state: current_term: 1 leader_uuid: "0f224983b554416eb06d1517c00bab25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f224983b554416eb06d1517c00bab25" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } } }
I20260619 02:48:49.895421 1464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:49.895438 1463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:49.895850 1471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:49.896186 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:49.896349 1471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:49.897790 1471 catalog_manager.cc:1347] Generated new cluster ID: 48021d9f5b0243e7a33327c805d8f65e
I20260619 02:48:49.897840 1471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:49.910178 1471 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:49.910408 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:49.897610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:33261 (local address 127.0.0.1:39433)
0619 02:48:49.897643 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:49.897645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:49.906764 (+ 9119us) server_negotiation.cc:407] Connection header received
0619 02:48:49.906830 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:49.906831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:49.906855 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:49.906919 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:49.907100 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:49.907830 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:49.908874 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:49.909187 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:49.909258 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:49.910101 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:49.910102 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:49.910103 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:49.910108 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:49.910125 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:49.910130 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:49.910187 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:49.910316 (+ 129us) server_negotiation.cc:299] Negotiation successful
0619 02:48:49.910330 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260619 02:48:49.910892 1471 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:49.913615 1471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f224983b554416eb06d1517c00bab25: Generated new TSK 0
I20260619 02:48:49.913789 1471 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:49.920773 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1389
W20260619 02:48:49.924635 1374 connection.cc:535] client connection to 127.0.0.1:39433 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39433): Connection reset by peer (error 104)
2026-06-19T02:48:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:49 dist-test-slave-fbl4 krb5kdc[1488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:49 dist-test-slave-fbl4 krb5kdc[1488](info): set up 2 sockets
Jun 19 02:48:49 dist-test-slave-fbl4 krb5kdc[1488](info): commencing operation
krb5kdc: starting...
W20260619 02:48:50.950749 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:51 dist-test-slave-fbl4 krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:51.063443 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35639
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:51.142046 1502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:51.142227 1502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:51.142249 1502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:51.143404 1502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:51.143458 1502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:51.143472 1502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:51.143523 1502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:51.143539 1502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:51.144984 1502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:51.145221 1502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:51.145437 1502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:51.150259 1510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:51.150327 1507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:51.150512 1502 server_base.cc:1034] running on GCE node
W20260619 02:48:51.150358 1508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:51.150810 1502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:51.151041 1502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:51.152220 1502 hybrid_clock.cc:648] HybridClock initialized: now 1781837331152213 us; error 39 us; skew 500 ppm
Jun 19 02:48:51 dist-test-slave-fbl4 krb5kdc[1488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837331, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:51.154723 1502 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:51.155097 1502 webserver.cc:460] Webserver started at http://127.0.0.1:40227/ using document root <none> and password file <none>
I20260619 02:48:51.155284 1502 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:51.155323 1502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:51.155411 1502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:51.156373 1502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "2404e97c384c43c8bbe462b0910bb151"
format_stamp: "Formatted at 2026-06-19 02:48:51 on dist-test-slave-fbl4"
server_key: "da297f5eb081795a6a184fd4973c2f5b"
server_key_iv: "1c6d35620c30ee6fce539121e0d4e798"
server_key_version: "encryptionkey@0"
I20260619 02:48:51.156664 1502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "2404e97c384c43c8bbe462b0910bb151"
format_stamp: "Formatted at 2026-06-19 02:48:51 on dist-test-slave-fbl4"
server_key: "da297f5eb081795a6a184fd4973c2f5b"
server_key_iv: "1c6d35620c30ee6fce539121e0d4e798"
server_key_version: "encryptionkey@0"
I20260619 02:48:51.157810 1502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:51.158469 1517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:51.158644 1502 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:51.158717 1502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "2404e97c384c43c8bbe462b0910bb151"
format_stamp: "Formatted at 2026-06-19 02:48:51 on dist-test-slave-fbl4"
server_key: "da297f5eb081795a6a184fd4973c2f5b"
server_key_iv: "1c6d35620c30ee6fce539121e0d4e798"
server_key_version: "encryptionkey@0"
I20260619 02:48:51.158766 1502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:51.161799 1502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:51.163911 1502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:51.164009 1502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:51.167583 1502 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35639
I20260619 02:48:51.167640 1569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35639 every 8 connection(s)
I20260619 02:48:51.167924 1502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:51.168838 1570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:51.171010 1570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151: Bootstrap starting.
I20260619 02:48:51.171558 1570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:51.171845 1570 log.cc:824] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:51.172485 1570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151: No bootstrap required, opened a new log
I20260619 02:48:51.174041 1570 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2404e97c384c43c8bbe462b0910bb151" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260619 02:48:51.174198 1570 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:51.174245 1570 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2404e97c384c43c8bbe462b0910bb151, State: Initialized, Role: FOLLOWER
I20260619 02:48:51.174404 1570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2404e97c384c43c8bbe462b0910bb151" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260619 02:48:51.174499 1570 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:51.174588 1570 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:51.174643 1570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:51.175129 1570 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2404e97c384c43c8bbe462b0910bb151" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260619 02:48:51.175248 1570 leader_election.cc:302] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2404e97c384c43c8bbe462b0910bb151; no voters:
I20260619 02:48:51.175419 1570 leader_election.cc:288] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:51.175457 1573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:51.175632 1573 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [term 1 LEADER]: Becoming Leader. State: Replica: 2404e97c384c43c8bbe462b0910bb151, State: Running, Role: LEADER
I20260619 02:48:51.175668 1570 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:51.175798 1573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2404e97c384c43c8bbe462b0910bb151" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260619 02:48:51.176177 1575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2404e97c384c43c8bbe462b0910bb151. Latest consensus state: current_term: 1 leader_uuid: "2404e97c384c43c8bbe462b0910bb151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2404e97c384c43c8bbe462b0910bb151" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } } }
I20260619 02:48:51.176163 1574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2404e97c384c43c8bbe462b0910bb151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2404e97c384c43c8bbe462b0910bb151" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } } }
I20260619 02:48:51.176261 1575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:51.176268 1574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:51.176543 1577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:51.177053 1577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:51.177611 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1502
I20260619 02:48:51.177731 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:51.177907 12869 external_mini_cluster.cc:1428] Setting key f00355749aab5370403265febd160571
I20260619 02:48:51.178766 1577 catalog_manager.cc:1347] Generated new cluster ID: 2d82e9064fb34e018c06e55bce48ea14
I20260619 02:48:51.178817 1577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:51.180066 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:51.178375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:38885 (local address 127.0.0.1:35639)
0619 02:48:51.178673 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:51.178682 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:51.178715 (+ 33us) server_negotiation.cc:407] Connection header received
0619 02:48:51.178824 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:51.178831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:51.178859 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:51.179005 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:51.179661 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:51.179665 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:51.179665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:51.179669 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:51.179721 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:51.179734 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:51.179803 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:51.179865 (+ 62us) server_negotiation.cc:299] Negotiation successful
0619 02:48:51.179906 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":62,"threads_started":1}
I20260619 02:48:51.184046 1577 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:51.184273 1577 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:51.184548 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:51.187520 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:51.186014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:48281 (local address 127.0.0.1:35639)
0619 02:48:51.186622 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:51.186623 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:51.186632 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:48:51.186661 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:51.186662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:51.186667 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:51.186726 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:51.187309 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:51.187311 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:51.187311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:51.187315 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:51.187329 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:51.187333 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:51.187392 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:51.187441 (+ 49us) server_negotiation.cc:299] Negotiation successful
0619 02:48:51.187455 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589}
I20260619 02:48:51.193029 1577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2404e97c384c43c8bbe462b0910bb151: Generated new TSK 0
I20260619 02:48:51.193185 1577 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:51.195780 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1502
2026-06-19T02:48:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1274 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:51 dist-test-slave-fbl4 krb5kdc[1601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:51 dist-test-slave-fbl4 krb5kdc[1601](info): set up 2 sockets
Jun 19 02:48:51 dist-test-slave-fbl4 krb5kdc[1601](info): commencing operation
krb5kdc: starting...
W20260619 02:48:52.230777 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:52 dist-test-slave-fbl4 krb5kdc[1601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:52.344759 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:52.424098 1614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:52.424289 1614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:52.424311 1614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:52.425417 1614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:52.425457 1614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:52.425472 1614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:52.425508 1614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:52.425535 1614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:52.427033 1614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36345
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:52.427273 1614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:52.427490 1614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:52.431919 1620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:52.431911 1622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:52.431911 1619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:52.432178 1614 server_base.cc:1034] running on GCE node
I20260619 02:48:52.432435 1614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:52.432713 1614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:52.433905 1614 hybrid_clock.cc:648] HybridClock initialized: now 1781837332433892 us; error 25 us; skew 500 ppm
Jun 19 02:48:52 dist-test-slave-fbl4 krb5kdc[1601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837332, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:52.439200 1614 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:52.439648 1614 webserver.cc:460] Webserver started at http://127.0.0.1:34737/ using document root <none> and password file <none>
I20260619 02:48:52.439824 1614 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:52.439877 1614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:52.439958 1614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:52.440968 1614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "2753f6243168408db4f55e551fdbc3c3"
format_stamp: "Formatted at 2026-06-19 02:48:52 on dist-test-slave-fbl4"
server_key: "6fd8d7fb38d7f448474a11ce9e2cfb57"
server_key_iv: "85eb0979f9608860edf59e089059e788"
server_key_version: "encryptionkey@0"
I20260619 02:48:52.441265 1614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "2753f6243168408db4f55e551fdbc3c3"
format_stamp: "Formatted at 2026-06-19 02:48:52 on dist-test-slave-fbl4"
server_key: "6fd8d7fb38d7f448474a11ce9e2cfb57"
server_key_iv: "85eb0979f9608860edf59e089059e788"
server_key_version: "encryptionkey@0"
I20260619 02:48:52.442466 1614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:48:52.443234 1629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:52.443413 1614 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:52.443553 1614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "2753f6243168408db4f55e551fdbc3c3"
format_stamp: "Formatted at 2026-06-19 02:48:52 on dist-test-slave-fbl4"
server_key: "6fd8d7fb38d7f448474a11ce9e2cfb57"
server_key_iv: "85eb0979f9608860edf59e089059e788"
server_key_version: "encryptionkey@0"
I20260619 02:48:52.443660 1614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:52.473485 1614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:52.476642 1614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:52.476799 1614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:52.481701 1614 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36345
I20260619 02:48:52.481784 1681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36345 every 8 connection(s)
I20260619 02:48:52.482189 1614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:52.483615 1682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:52.487643 1682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3: Bootstrap starting.
I20260619 02:48:52.488428 1682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:52.488801 1682 log.cc:824] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:52.489671 1682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3: No bootstrap required, opened a new log
I20260619 02:48:52.489655 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1614
I20260619 02:48:52.489769 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:52.489959 12869 external_mini_cluster.cc:1428] Setting key 45f2fdd112fdde626d603be4b406d17d
I20260619 02:48:52.492478 1682 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2753f6243168408db4f55e551fdbc3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36345 } }
I20260619 02:48:52.492652 1682 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:52.492702 1682 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2753f6243168408db4f55e551fdbc3c3, State: Initialized, Role: FOLLOWER
I20260619 02:48:52.492848 1682 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2753f6243168408db4f55e551fdbc3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36345 } }
I20260619 02:48:52.492976 1682 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:52.493044 1682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:52.493103 1682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:52.493852 1682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2753f6243168408db4f55e551fdbc3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36345 } }
I20260619 02:48:52.493976 1682 leader_election.cc:302] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2753f6243168408db4f55e551fdbc3c3; no voters:
I20260619 02:48:52.494151 1682 leader_election.cc:288] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:52.494226 1687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:52.494396 1682 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:52.494392 1687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2753f6243168408db4f55e551fdbc3c3, State: Running, Role: LEADER
I20260619 02:48:52.495837 1687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2753f6243168408db4f55e551fdbc3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36345 } }
I20260619 02:48:52.496691 1688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2753f6243168408db4f55e551fdbc3c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2753f6243168408db4f55e551fdbc3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36345 } } }
I20260619 02:48:52.496780 1688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:52.496577 1689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2753f6243168408db4f55e551fdbc3c3. Latest consensus state: current_term: 1 leader_uuid: "2753f6243168408db4f55e551fdbc3c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2753f6243168408db4f55e551fdbc3c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36345 } } }
I20260619 02:48:52.497064 1689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3 [sys.catalog]: This master's current role is: LEADER
W20260619 02:48:52.497535 1701 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:48:52.497588 1701 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:48:52.497663 1703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:52.497828 1703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:52.499720 1703 catalog_manager.cc:1347] Generated new cluster ID: 1edea1b405324f1c951115f01edf7b9b
I20260619 02:48:52.499771 1703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:48:52 dist-test-slave-fbl4 krb5kdc[1601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 02:48:52.504209 1686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:52.490460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:55605 (local address 127.0.0.1:36345)
0619 02:48:52.490878 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:52.490887 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:52.490917 (+ 30us) server_negotiation.cc:407] Connection header received
0619 02:48:52.492432 (+ 1515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:52.492441 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:52.492522 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:52.492730 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:52.493527 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:52.495022 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:52.496164 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:52.496791 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:52.497441 (+ 650us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:52.500961 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:52.500965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:52.500965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:52.500976 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:52.502684 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:52.503078 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:52.503081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:52.503081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:52.503169 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:52.503411 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:52.503412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:52.503412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:52.503647 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:52.503817 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:52.503918 (+ 101us) server_negotiation.cc:299] Negotiation successful
0619 02:48:52.504014 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":111,"threads_started":1}
I20260619 02:48:52.505093 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:52.513005 1686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:52.506378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:51931 (local address 127.0.0.1:36345)
0619 02:48:52.506410 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:52.506412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:52.506511 (+ 99us) server_negotiation.cc:407] Connection header received
0619 02:48:52.506599 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:52.506600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:52.506609 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:52.506662 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:52.507136 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:52.507615 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:52.508310 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:52.508538 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:52.508634 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:52.509791 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:52.509792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:52.509792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:52.509799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:52.511605 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:52.512105 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:52.512106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:52.512106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:52.512184 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:52.512446 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:52.512447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:52.512447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:52.512577 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:52.512691 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:52.512846 (+ 155us) server_negotiation.cc:299] Negotiation successful
0619 02:48:52.512910 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:48:52.523170 1703 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:52.523865 1703 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:52.530727 1703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2753f6243168408db4f55e551fdbc3c3: Generated new TSK 0
I20260619 02:48:52.530892 1703 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:52.536674 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1614
W20260619 02:48:52.542013 1599 connection.cc:535] client connection to 127.0.0.1:36345 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36345): Connection reset by peer (error 104)
2026-06-19T02:48:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1342 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:52 dist-test-slave-fbl4 krb5kdc[1713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:52 dist-test-slave-fbl4 krb5kdc[1713](info): set up 2 sockets
Jun 19 02:48:52 dist-test-slave-fbl4 krb5kdc[1713](info): commencing operation
krb5kdc: starting...
W20260619 02:48:53.566764 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.011s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:53 dist-test-slave-fbl4 krb5kdc[1713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:53.679082 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38967
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:53.758014 1726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:53.758246 1726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:53.758281 1726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:53.759457 1726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:53.759522 1726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:53.759546 1726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:53.759567 1726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:53.759595 1726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:53.761016 1726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38967
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:53.761286 1726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:53.761502 1726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:53.766131 1731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:53.766209 1726 server_base.cc:1034] running on GCE node
W20260619 02:48:53.766140 1732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:53.766137 1734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:53.766535 1726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:53.766886 1726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:53.768040 1726 hybrid_clock.cc:648] HybridClock initialized: now 1781837333768029 us; error 41 us; skew 500 ppm
Jun 19 02:48:53 dist-test-slave-fbl4 krb5kdc[1713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837333, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:53.770332 1726 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:53.770750 1726 webserver.cc:460] Webserver started at http://127.0.0.1:38823/ using document root <none> and password file <none>
I20260619 02:48:53.770922 1726 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:53.770961 1726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:53.771046 1726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:53.771978 1726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "9b166cb36efb4b919bdc96c7e3354c16"
format_stamp: "Formatted at 2026-06-19 02:48:53 on dist-test-slave-fbl4"
server_key: "b135ca5fe831009199250ed9bce9736a"
server_key_iv: "15009677d8339fb336e3f195f9ad86e3"
server_key_version: "encryptionkey@0"
I20260619 02:48:53.772271 1726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "9b166cb36efb4b919bdc96c7e3354c16"
format_stamp: "Formatted at 2026-06-19 02:48:53 on dist-test-slave-fbl4"
server_key: "b135ca5fe831009199250ed9bce9736a"
server_key_iv: "15009677d8339fb336e3f195f9ad86e3"
server_key_version: "encryptionkey@0"
I20260619 02:48:53.773551 1726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:48:53.774201 1741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:53.774391 1726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:53.774497 1726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "9b166cb36efb4b919bdc96c7e3354c16"
format_stamp: "Formatted at 2026-06-19 02:48:53 on dist-test-slave-fbl4"
server_key: "b135ca5fe831009199250ed9bce9736a"
server_key_iv: "15009677d8339fb336e3f195f9ad86e3"
server_key_version: "encryptionkey@0"
I20260619 02:48:53.774607 1726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:53.788187 1726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:53.789876 1726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:53.790026 1726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:53.793733 1726 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38967
I20260619 02:48:53.793788 1793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38967 every 8 connection(s)
I20260619 02:48:53.794102 1726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:53.794956 1794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:53.797106 1794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16: Bootstrap starting.
I20260619 02:48:53.797652 1794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:53.797936 1794 log.cc:824] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:53.798640 1794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16: No bootstrap required, opened a new log
I20260619 02:48:53.800170 1794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b166cb36efb4b919bdc96c7e3354c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38967 } }
I20260619 02:48:53.800315 1794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:53.800357 1794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b166cb36efb4b919bdc96c7e3354c16, State: Initialized, Role: FOLLOWER
I20260619 02:48:53.800531 1794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b166cb36efb4b919bdc96c7e3354c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38967 } }
I20260619 02:48:53.800622 1794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:53.800664 1794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:53.800714 1794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:53.801353 1794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b166cb36efb4b919bdc96c7e3354c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38967 } }
I20260619 02:48:53.801465 1794 leader_election.cc:302] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b166cb36efb4b919bdc96c7e3354c16; no voters:
I20260619 02:48:53.801631 1794 leader_election.cc:288] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:53.801680 1797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:53.801852 1797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [term 1 LEADER]: Becoming Leader. State: Replica: 9b166cb36efb4b919bdc96c7e3354c16, State: Running, Role: LEADER
I20260619 02:48:53.801903 1794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:53.801954 1797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b166cb36efb4b919bdc96c7e3354c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38967 } }
I20260619 02:48:53.802273 1798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b166cb36efb4b919bdc96c7e3354c16. Latest consensus state: current_term: 1 leader_uuid: "9b166cb36efb4b919bdc96c7e3354c16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b166cb36efb4b919bdc96c7e3354c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38967 } } }
I20260619 02:48:53.802361 1798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:53.802400 1799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b166cb36efb4b919bdc96c7e3354c16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b166cb36efb4b919bdc96c7e3354c16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38967 } } }
I20260619 02:48:53.802505 1799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:53.803323 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1726
I20260619 02:48:53.803339 1803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:53.803483 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:53.803695 12869 external_mini_cluster.cc:1428] Setting key 9b1fe075c21b2abbb30f24f396c35940
I20260619 02:48:53.803812 1803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:53.805187 1803 catalog_manager.cc:1347] Generated new cluster ID: 64124e2b8738452c93eabee996009992
I20260619 02:48:53.805236 1803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:53.809983 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:53.804373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:38033 (local address 127.0.0.1:38967)
0619 02:48:53.804870 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:53.804879 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:53.804909 (+ 30us) server_negotiation.cc:407] Connection header received
0619 02:48:53.805024 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:53.805030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:53.805093 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:53.805233 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:53.805556 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:53.806926 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:53.807985 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:53.808546 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:53.808651 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:53.809316 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:53.809319 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:53.809319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:53.809529 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:53.809565 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:53.809578 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:53.809653 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:53.809763 (+ 110us) server_negotiation.cc:299] Negotiation successful
0619 02:48:53.809786 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":82,"threads_started":1}
I20260619 02:48:53.810792 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:53.815758 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:53.812269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:40621 (local address 127.0.0.1:38967)
0619 02:48:53.812298 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:53.812299 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:53.812452 (+ 153us) server_negotiation.cc:407] Connection header received
0619 02:48:53.812511 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:53.812511 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:53.812528 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:53.812593 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:53.812722 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:53.813455 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:53.814487 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:53.814808 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:53.814864 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:53.815492 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:53.815493 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:53.815494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:53.815497 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:53.815510 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:53.815514 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:53.815568 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:53.815648 (+ 80us) server_negotiation.cc:299] Negotiation successful
0619 02:48:53.815659 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260619 02:48:53.821405 1803 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:53.821961 1803 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:53.829749 1803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b166cb36efb4b919bdc96c7e3354c16: Generated new TSK 0
I20260619 02:48:53.829922 1803 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:53.835527 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1726
W20260619 02:48:53.839650 1711 connection.cc:535] client connection to 127.0.0.1:38967 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38967): Connection reset by peer (error 104)
2026-06-19T02:48:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1297 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:53 dist-test-slave-fbl4 krb5kdc[1825](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:53 dist-test-slave-fbl4 krb5kdc[1825](info): set up 2 sockets
Jun 19 02:48:53 dist-test-slave-fbl4 krb5kdc[1825](info): commencing operation
krb5kdc: starting...
W20260619 02:48:54.870823 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:54 dist-test-slave-fbl4 krb5kdc[1825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 02:48:54.983719 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33289
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:55.061261 1838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:55.061484 1838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:55.061518 1838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:55.062647 1838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:55.062709 1838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:55.062732 1838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:55.062753 1838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:55.062778 1838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:55.064170 1838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33289
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:55.064435 1838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:55.064649 1838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:55.069326 1844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:55.069360 1843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:55.069629 1846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:55.074223 1838 server_base.cc:1034] running on GCE node
I20260619 02:48:55.074503 1838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:55.074851 1838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:55.076028 1838 hybrid_clock.cc:648] HybridClock initialized: now 1781837335075997 us; error 43 us; skew 500 ppm
Jun 19 02:48:55 dist-test-slave-fbl4 krb5kdc[1825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837335, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:55.078415 1838 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 02:48:55.078896 1838 webserver.cc:460] Webserver started at http://127.0.0.1:34437/ using document root <none> and password file <none>
I20260619 02:48:55.079128 1838 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:55.079172 1838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:55.079312 1838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:55.080324 1838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "5f7465ac6a7245feb507f81101e39c1a"
format_stamp: "Formatted at 2026-06-19 02:48:55 on dist-test-slave-fbl4"
server_key: "9346ea4bee5b2d6cfd46f18cf8900846"
server_key_iv: "6295caebda6eb6c2751447c2ad25abd2"
server_key_version: "encryptionkey@0"
I20260619 02:48:55.080662 1838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "5f7465ac6a7245feb507f81101e39c1a"
format_stamp: "Formatted at 2026-06-19 02:48:55 on dist-test-slave-fbl4"
server_key: "9346ea4bee5b2d6cfd46f18cf8900846"
server_key_iv: "6295caebda6eb6c2751447c2ad25abd2"
server_key_version: "encryptionkey@0"
I20260619 02:48:55.081908 1838 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:55.082605 1853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:55.082757 1838 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:55.082850 1838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "5f7465ac6a7245feb507f81101e39c1a"
format_stamp: "Formatted at 2026-06-19 02:48:55 on dist-test-slave-fbl4"
server_key: "9346ea4bee5b2d6cfd46f18cf8900846"
server_key_iv: "6295caebda6eb6c2751447c2ad25abd2"
server_key_version: "encryptionkey@0"
I20260619 02:48:55.082929 1838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:55.086035 1838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:55.087863 1838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:55.088006 1838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:55.091850 1838 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33289
I20260619 02:48:55.091879 1905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33289 every 8 connection(s)
I20260619 02:48:55.092175 1838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:55.092990 1906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:55.095094 1906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a: Bootstrap starting.
I20260619 02:48:55.095598 1906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:55.095824 1906 log.cc:824] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:55.096388 1906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a: No bootstrap required, opened a new log
I20260619 02:48:55.097913 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1838
I20260619 02:48:55.098047 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:55.098022 1906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7465ac6a7245feb507f81101e39c1a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33289 } }
I20260619 02:48:55.098186 1906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:55.098232 1906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7465ac6a7245feb507f81101e39c1a, State: Initialized, Role: FOLLOWER
I20260619 02:48:55.098253 12869 external_mini_cluster.cc:1428] Setting key b96cc061c4710746d76cdba6d2ba226c
I20260619 02:48:55.098372 1906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7465ac6a7245feb507f81101e39c1a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33289 } }
I20260619 02:48:55.098456 1906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:55.098515 1906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:55.098582 1906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:55.099212 1906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7465ac6a7245feb507f81101e39c1a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33289 } }
I20260619 02:48:55.099294 1906 leader_election.cc:302] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f7465ac6a7245feb507f81101e39c1a; no voters:
I20260619 02:48:55.099465 1906 leader_election.cc:288] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:55.099546 1911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:55.099660 1911 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [term 1 LEADER]: Becoming Leader. State: Replica: 5f7465ac6a7245feb507f81101e39c1a, State: Running, Role: LEADER
I20260619 02:48:55.099714 1906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:55.099735 1911 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7465ac6a7245feb507f81101e39c1a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33289 } }
I20260619 02:48:55.100031 1911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f7465ac6a7245feb507f81101e39c1a. Latest consensus state: current_term: 1 leader_uuid: "5f7465ac6a7245feb507f81101e39c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7465ac6a7245feb507f81101e39c1a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33289 } } }
I20260619 02:48:55.100040 1913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f7465ac6a7245feb507f81101e39c1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7465ac6a7245feb507f81101e39c1a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33289 } } }
I20260619 02:48:55.100124 1911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:55.100142 1913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:55.100621 1918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:55.101236 1918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:55.101404 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:55.098714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:34473 (local address 127.0.0.1:33289)
0619 02:48:55.098894 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:55.098902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:55.098932 (+ 30us) server_negotiation.cc:407] Connection header received
0619 02:48:55.099225 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:55.099230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:55.099253 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:55.099418 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:55.100791 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:55.100794 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:55.100795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:55.100799 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:55.100838 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:55.100869 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:55.100953 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:55.101133 (+ 180us) server_negotiation.cc:299] Negotiation successful
0619 02:48:55.101175 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260619 02:48:55.102528 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:55.102838 1918 catalog_manager.cc:1347] Generated new cluster ID: 243c1500c19948408245022ef8dbe006
I20260619 02:48:55.102885 1918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:55.104933 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:55.103875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:58479 (local address 127.0.0.1:33289)
0619 02:48:55.103909 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:55.103912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:55.104045 (+ 133us) server_negotiation.cc:407] Connection header received
0619 02:48:55.104131 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:55.104132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:55.104136 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:55.104190 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:55.104718 (+ 528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:55.104719 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:55.104720 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:55.104723 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:55.104735 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:55.104739 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:55.104780 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:55.104841 (+ 61us) server_negotiation.cc:299] Negotiation successful
0619 02:48:55.104854 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:48:55.111994 1918 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:55.112138 1918 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:55.116768 1918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f7465ac6a7245feb507f81101e39c1a: Generated new TSK 0
I20260619 02:48:55.116932 1918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:55.118602 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1838
2026-06-19T02:48:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1282 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:55 dist-test-slave-fbl4 krb5kdc[1937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:55 dist-test-slave-fbl4 krb5kdc[1937](info): set up 2 sockets
Jun 19 02:48:55 dist-test-slave-fbl4 krb5kdc[1937](info): commencing operation
krb5kdc: starting...
W20260619 02:48:56.150728 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:56 dist-test-slave-fbl4 krb5kdc[1937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:48:56.265012 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45225
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:36521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:45225
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:56.343840 1950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:56.344084 1950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:56.344125 1950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:56.345285 1950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:56.345352 1950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:56.345376 1950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:56.345399 1950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:56.345424 1950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:56.346909 1950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:36521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:45225
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:56.347187 1950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:56.347409 1950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:56.352016 1956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:56.352057 1958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:56.352029 1955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:56.352344 1950 server_base.cc:1034] running on GCE node
I20260619 02:48:56.352605 1950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:56.352924 1950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:56.354077 1950 hybrid_clock.cc:648] HybridClock initialized: now 1781837336354066 us; error 26 us; skew 500 ppm
Jun 19 02:48:56 dist-test-slave-fbl4 krb5kdc[1937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837336, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:56.356477 1950 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:48:56.356892 1950 webserver.cc:460] Webserver started at http://127.12.145.126:43839/ using document root <none> and password file <none>
I20260619 02:48:56.357120 1950 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:56.357164 1950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:56.357312 1950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:56.358332 1950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "ebd8a304463a42ea9e6fdc463f92fc13"
format_stamp: "Formatted at 2026-06-19 02:48:56 on dist-test-slave-fbl4"
server_key: "5c1c55092fb7609f2740780da641b789"
server_key_iv: "1f694511621b2ff72d2cd18140a2fc91"
server_key_version: "encryptionkey@0"
I20260619 02:48:56.358701 1950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "ebd8a304463a42ea9e6fdc463f92fc13"
format_stamp: "Formatted at 2026-06-19 02:48:56 on dist-test-slave-fbl4"
server_key: "5c1c55092fb7609f2740780da641b789"
server_key_iv: "1f694511621b2ff72d2cd18140a2fc91"
server_key_version: "encryptionkey@0"
I20260619 02:48:56.359968 1950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260619 02:48:56.360656 1965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:56.360855 1950 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:56.360965 1950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "ebd8a304463a42ea9e6fdc463f92fc13"
format_stamp: "Formatted at 2026-06-19 02:48:56 on dist-test-slave-fbl4"
server_key: "5c1c55092fb7609f2740780da641b789"
server_key_iv: "1f694511621b2ff72d2cd18140a2fc91"
server_key_version: "encryptionkey@0"
I20260619 02:48:56.361020 1950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:56.386348 1950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:56.388171 1950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:56.388274 1950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:56.391873 1950 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:45225
I20260619 02:48:56.391938 2017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:45225 every 8 connection(s)
I20260619 02:48:56.392248 1950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:56.393095 2018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:56.395300 2018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13: Bootstrap starting.
I20260619 02:48:56.395848 2018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:56.396127 2018 log.cc:824] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:56.396771 2018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13: No bootstrap required, opened a new log
I20260619 02:48:56.398300 2018 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45225 } }
I20260619 02:48:56.398447 2018 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:56.398500 2018 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebd8a304463a42ea9e6fdc463f92fc13, State: Initialized, Role: FOLLOWER
I20260619 02:48:56.398655 2018 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45225 } }
I20260619 02:48:56.398737 2018 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:56.398779 2018 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:56.398829 2018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:56.399523 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 1950
I20260619 02:48:56.399653 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:56.399775 2018 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45225 } }
I20260619 02:48:56.399842 12869 external_mini_cluster.cc:1428] Setting key 76367f23059d4ab50d6a52278c6b9da3
I20260619 02:48:56.399878 2018 leader_election.cc:302] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebd8a304463a42ea9e6fdc463f92fc13; no voters:
I20260619 02:48:56.400058 2018 leader_election.cc:288] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:56.400070 2021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:56.400203 2021 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [term 1 LEADER]: Becoming Leader. State: Replica: ebd8a304463a42ea9e6fdc463f92fc13, State: Running, Role: LEADER
I20260619 02:48:56.400274 2021 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45225 } }
I20260619 02:48:56.400318 2018 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:56.400579 2021 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45225 } } }
I20260619 02:48:56.400650 2021 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:56.400604 2022 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebd8a304463a42ea9e6fdc463f92fc13. Latest consensus state: current_term: 1 leader_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebd8a304463a42ea9e6fdc463f92fc13" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45225 } } }
I20260619 02:48:56.400807 2022 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:56.401269 2027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:56.401803 2027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:56.403321 2027 catalog_manager.cc:1347] Generated new cluster ID: d4328bb6afd44def8826bfb52eb016cc
I20260619 02:48:56.403369 2027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:48:56 dist-test-slave-fbl4 krb5kdc[1937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:48:56.410251 2027 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:56.410960 2027 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:56.412457 2025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:56.400265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52367 (local address 127.12.145.126:45225)
0619 02:48:56.400513 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:56.400520 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:56.401105 (+ 585us) server_negotiation.cc:407] Connection header received
0619 02:48:56.401226 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:56.401233 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:56.401290 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:56.401490 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:56.402219 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:56.403594 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:56.404627 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:56.405251 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:56.405364 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:56.408069 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:56.408074 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:56.408074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:56.408086 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:56.410760 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:56.411179 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:56.411182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:56.411183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:56.411276 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:56.411517 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:56.411518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:56.411518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:56.411771 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:56.411935 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:56.412053 (+ 118us) server_negotiation.cc:299] Negotiation successful
0619 02:48:56.412241 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":62,"threads_started":1}
I20260619 02:48:56.413650 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:56.418475 2027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebd8a304463a42ea9e6fdc463f92fc13: Generated new TSK 0
I20260619 02:48:56.419528 2027 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:56.421893 2025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:56.415149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47959 (local address 127.12.145.126:45225)
0619 02:48:56.415177 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:56.415179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:56.415190 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:48:56.415261 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:56.415262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:56.415269 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:56.415318 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:56.415901 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:56.416640 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:56.417651 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:56.417960 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:56.418024 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:56.419447 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:56.419449 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:56.419449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:48:56.419455 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:56.420872 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:56.421265 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:56.421266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:56.421266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:56.421311 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:48:56.421511 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:48:56.421511 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:48:56.421512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:48:56.421595 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:56.421663 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:56.421802 (+ 139us) server_negotiation.cc:299] Negotiation successful
0619 02:48:56.421843 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260619 02:48:56.423666 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 1950
W20260619 02:48:56.427826 1935 connection.cc:535] client connection to 127.12.145.126:45225 recv error: Network error: failed to read from TLS socket (remote: 127.12.145.126:45225): Connection reset by peer (error 104)
2026-06-19T02:48:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1305 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:56 dist-test-slave-fbl4 krb5kdc[2049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:56 dist-test-slave-fbl4 krb5kdc[2049](info): set up 2 sockets
Jun 19 02:48:56 dist-test-slave-fbl4 krb5kdc[2049](info): commencing operation
krb5kdc: starting...
W20260619 02:48:57.462615 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:57 dist-test-slave-fbl4 krb5kdc[2049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:48:57.574210 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:40337
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:40337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:57.654345 2062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:57.654536 2062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:57.654574 2062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:57.655639 2062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:57.655673 2062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:57.655686 2062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:57.655699 2062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:57.655711 2062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:57.657161 2062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:40337
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:40337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:57.657342 2062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:57.657495 2062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:57.662146 2067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:57.662132 2070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:57.662122 2068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:57.662468 2062 server_base.cc:1034] running on GCE node
I20260619 02:48:57.662734 2062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:57.662961 2062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:57.664114 2062 hybrid_clock.cc:648] HybridClock initialized: now 1781837337664099 us; error 32 us; skew 500 ppm
Jun 19 02:48:57 dist-test-slave-fbl4 krb5kdc[2049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837337, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:57.669456 2062 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:48:57.669872 2062 webserver.cc:460] Webserver started at http://127.12.145.126:34301/ using document root <none> and password file <none>
I20260619 02:48:57.670090 2062 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:57.670135 2062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:57.670276 2062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:57.671383 2062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "90d5f944c8e8478ea0cf4ec159d1df65"
format_stamp: "Formatted at 2026-06-19 02:48:57 on dist-test-slave-fbl4"
server_key: "9fe0a4a734199835bcef25e58632a9e0"
server_key_iv: "b9662c6399c80271d95cd1a561a59770"
server_key_version: "encryptionkey@0"
I20260619 02:48:57.671722 2062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "90d5f944c8e8478ea0cf4ec159d1df65"
format_stamp: "Formatted at 2026-06-19 02:48:57 on dist-test-slave-fbl4"
server_key: "9fe0a4a734199835bcef25e58632a9e0"
server_key_iv: "b9662c6399c80271d95cd1a561a59770"
server_key_version: "encryptionkey@0"
I20260619 02:48:57.673003 2062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260619 02:48:57.673689 2077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:57.673851 2062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260619 02:48:57.673949 2062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "90d5f944c8e8478ea0cf4ec159d1df65"
format_stamp: "Formatted at 2026-06-19 02:48:57 on dist-test-slave-fbl4"
server_key: "9fe0a4a734199835bcef25e58632a9e0"
server_key_iv: "b9662c6399c80271d95cd1a561a59770"
server_key_version: "encryptionkey@0"
I20260619 02:48:57.674017 2062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:57.685895 2062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:57.687742 2062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:57.687898 2062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:57.691609 2062 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:40337
I20260619 02:48:57.691653 2129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:40337 every 8 connection(s)
I20260619 02:48:57.691970 2062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:57.692793 2130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:57.695014 2130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65: Bootstrap starting.
I20260619 02:48:57.695559 2130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:57.695837 2130 log.cc:824] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:57.696446 2130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65: No bootstrap required, opened a new log
I20260619 02:48:57.697968 2130 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 40337 } }
I20260619 02:48:57.698122 2130 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:57.698143 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2062
I20260619 02:48:57.698167 2130 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d5f944c8e8478ea0cf4ec159d1df65, State: Initialized, Role: FOLLOWER
I20260619 02:48:57.698274 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:57.698351 2130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 40337 } }
I20260619 02:48:57.698449 2130 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:57.698464 12869 external_mini_cluster.cc:1428] Setting key b5ca8e8d1e33b21f96c50fcfac1883ca
I20260619 02:48:57.698498 2130 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:57.698592 2130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:57.699242 2130 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 40337 } }
I20260619 02:48:57.699353 2130 leader_election.cc:302] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90d5f944c8e8478ea0cf4ec159d1df65; no voters:
I20260619 02:48:57.699525 2135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:57.699512 2130 leader_election.cc:288] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:57.699714 2135 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [term 1 LEADER]: Becoming Leader. State: Replica: 90d5f944c8e8478ea0cf4ec159d1df65, State: Running, Role: LEADER
I20260619 02:48:57.699796 2135 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 40337 } }
I20260619 02:48:57.699855 2130 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:57.700093 2136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90d5f944c8e8478ea0cf4ec159d1df65. Latest consensus state: current_term: 1 leader_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 40337 } } }
I20260619 02:48:57.700192 2136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:57.700328 2137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90d5f944c8e8478ea0cf4ec159d1df65" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 40337 } } }
I20260619 02:48:57.700387 2137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65 [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:57.700484 2141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:57.700929 2141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:57.702693 2141 catalog_manager.cc:1347] Generated new cluster ID: acde5b0e6f67464ea8f683d8fc26ee32
I20260619 02:48:57.702744 2141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:57.704420 2134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:57.698964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42375 (local address 127.12.145.126:40337)
0619 02:48:57.699478 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:57.699486 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:57.699509 (+ 23us) server_negotiation.cc:407] Connection header received
0619 02:48:57.699596 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:57.699617 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:57.699670 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:57.700031 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:57.700128 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:57.701559 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:57.702519 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:57.703117 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:57.703212 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:57.703821 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:57.703825 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:57.703825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:57.704007 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:57.704046 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:57.704059 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:57.704126 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:57.704202 (+ 76us) server_negotiation.cc:299] Negotiation successful
0619 02:48:57.704226 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":433,"threads_started":1}
I20260619 02:48:57.705264 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:57.709296 2134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:57.706578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45989 (local address 127.12.145.126:40337)
0619 02:48:57.706612 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:57.706613 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:57.706722 (+ 109us) server_negotiation.cc:407] Connection header received
0619 02:48:57.706782 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:57.706783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:57.706790 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:57.706833 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:57.706946 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:57.707381 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:57.708338 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:48:57.708545 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:48:57.708594 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:48:57.709111 (+ 517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:57.709112 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:57.709112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:57.709116 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:57.709127 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:57.709131 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:57.709178 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:57.709242 (+ 64us) server_negotiation.cc:299] Negotiation successful
0619 02:48:57.709252 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260619 02:48:57.711413 2141 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:57.712020 2141 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:57.714325 2141 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90d5f944c8e8478ea0cf4ec159d1df65: Generated new TSK 0
I20260619 02:48:57.714512 2141 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:57.722308 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2062
W20260619 02:48:57.726089 2047 connection.cc:535] client connection to 127.12.145.126:40337 recv error: Network error: failed to read from TLS socket (remote: 127.12.145.126:40337): Connection reset by peer (error 104)
2026-06-19T02:48:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1298 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:57 dist-test-slave-fbl4 krb5kdc[2162](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:57 dist-test-slave-fbl4 krb5kdc[2162](info): set up 2 sockets
Jun 19 02:48:57 dist-test-slave-fbl4 krb5kdc[2162](info): commencing operation
krb5kdc: starting...
W20260619 02:48:58.742756 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.003s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:48:58 dist-test-slave-fbl4 krb5kdc[2162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:48:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:48:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:48:58.853394 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:43077
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:34267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:43077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:48:58.934170 2175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:48:58.934363 2175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:48:58.934387 2175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:48:58.935526 2175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:48:58.935571 2175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:48:58.935585 2175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:48:58.935598 2175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:48:58.935645 2175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:48:58.937041 2175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:43077
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:43077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:48:58.937265 2175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:48:58.937486 2175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:48:58.942028 2181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:48:58.942055 2183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:58.942063 2175 server_base.cc:1034] running on GCE node
W20260619 02:48:58.942034 2180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:48:58.942487 2175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:48:58.942781 2175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:48:58.943914 2175 hybrid_clock.cc:648] HybridClock initialized: now 1781837338943921 us; error 46 us; skew 500 ppm
Jun 19 02:48:58 dist-test-slave-fbl4 krb5kdc[2162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837338, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:48:58.946151 2175 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:48:58.946646 2175 webserver.cc:460] Webserver started at http://127.12.145.126:44349/ using document root <none> and password file <none>
I20260619 02:48:58.946863 2175 fs_manager.cc:359] Metadata directory not provided
I20260619 02:48:58.946924 2175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:48:58.947053 2175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:48:58.948019 2175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d"
format_stamp: "Formatted at 2026-06-19 02:48:58 on dist-test-slave-fbl4"
server_key: "4bc0eab822f1ccdfdaca6f9613d396c5"
server_key_iv: "a6aadd20b7c2d1b79d843f61b756336d"
server_key_version: "encryptionkey@0"
I20260619 02:48:58.948348 2175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d"
format_stamp: "Formatted at 2026-06-19 02:48:58 on dist-test-slave-fbl4"
server_key: "4bc0eab822f1ccdfdaca6f9613d396c5"
server_key_iv: "a6aadd20b7c2d1b79d843f61b756336d"
server_key_version: "encryptionkey@0"
I20260619 02:48:58.949635 2175 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:48:58.950322 2190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:48:58.950490 2175 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:48:58.950631 2175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d"
format_stamp: "Formatted at 2026-06-19 02:48:58 on dist-test-slave-fbl4"
server_key: "4bc0eab822f1ccdfdaca6f9613d396c5"
server_key_iv: "a6aadd20b7c2d1b79d843f61b756336d"
server_key_version: "encryptionkey@0"
I20260619 02:48:58.950711 2175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:48:58.953768 2175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:48:58.955610 2175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:48:58.955752 2175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:48:58.959771 2175 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:43077
I20260619 02:48:58.959831 2242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:43077 every 8 connection(s)
I20260619 02:48:58.960129 2175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:48:58.961000 2243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:48:58.963096 2243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d: Bootstrap starting.
I20260619 02:48:58.963603 2243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d: Neither blocks nor log segments found. Creating new log.
I20260619 02:48:58.963853 2243 log.cc:824] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d: Log is configured to *not* fsync() on all Append() calls
I20260619 02:48:58.964471 2243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d: No bootstrap required, opened a new log
I20260619 02:48:58.966006 2243 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43077 } }
I20260619 02:48:58.966125 2243 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:48:58.966144 2243 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d2aadb850ad4334a1bce7cf9ed3f46d, State: Initialized, Role: FOLLOWER
I20260619 02:48:58.966331 2243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43077 } }
I20260619 02:48:58.966388 2243 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:48:58.966435 2243 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:48:58.966493 2243 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:48:58.967264 2243 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43077 } }
I20260619 02:48:58.967378 2243 leader_election.cc:302] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d2aadb850ad4334a1bce7cf9ed3f46d; no voters:
I20260619 02:48:58.967540 2243 leader_election.cc:288] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:48:58.967566 2246 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:48:58.967631 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2175
I20260619 02:48:58.967671 2246 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [term 1 LEADER]: Becoming Leader. State: Replica: 3d2aadb850ad4334a1bce7cf9ed3f46d, State: Running, Role: LEADER
I20260619 02:48:58.967736 2246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43077 } }
I20260619 02:48:58.967756 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:48:58.967772 2243 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:48:58.967935 12869 external_mini_cluster.cc:1428] Setting key 61eac09208dbe6f5f0e045bc39f9bcef
I20260619 02:48:58.968073 2247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43077 } } }
I20260619 02:48:58.968156 2247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:58.968371 2248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d2aadb850ad4334a1bce7cf9ed3f46d. Latest consensus state: current_term: 1 leader_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d2aadb850ad4334a1bce7cf9ed3f46d" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 43077 } } }
I20260619 02:48:58.968683 2248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d [sys.catalog]: This master's current role is: LEADER
I20260619 02:48:58.968927 2252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:48:58.969480 2252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:48:58.970623 2258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:58.968510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33431 (local address 127.12.145.126:43077)
0619 02:48:58.968659 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:58.968669 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:58.968788 (+ 119us) server_negotiation.cc:407] Connection header received
0619 02:48:58.968941 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:58.968948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:58.968978 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:58.969153 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:58.970088 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:58.970092 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:58.970093 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:58.970097 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:58.970144 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:58.970160 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:58.970222 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:58.970335 (+ 113us) server_negotiation.cc:299] Negotiation successful
0619 02:48:58.970379 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":82,"threads_started":1}
I20260619 02:48:58.971105 2252 catalog_manager.cc:1347] Generated new cluster ID: 9eca945b94a440989475c0db4b19a153
I20260619 02:48:58.971155 2252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:48:58.971437 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:48:58.973866 2258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:48:58.972804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36765 (local address 127.12.145.126:43077)
0619 02:48:58.972833 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0619 02:48:58.972835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:48:58.972962 (+ 127us) server_negotiation.cc:407] Connection header received
0619 02:48:58.973048 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:48:58.973049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:48:58.973052 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:48:58.973077 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:48:58.973658 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:48:58.973659 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:48:58.973659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:48:58.973663 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:48:58.973672 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:48:58.973676 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:48:58.973701 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0619 02:48:58.973789 (+ 88us) server_negotiation.cc:299] Negotiation successful
0619 02:48:58.973800 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260619 02:48:58.986780 2252 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:48:58.986936 2252 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:48:58.992762 2252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d2aadb850ad4334a1bce7cf9ed3f46d: Generated new TSK 0
I20260619 02:48:58.992923 2252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:48:58.999964 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2175
2026-06-19T02:48:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1277 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:48:59 dist-test-slave-fbl4 krb5kdc[2274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:48:59 dist-test-slave-fbl4 krb5kdc[2274](info): set up 2 sockets
Jun 19 02:48:59 dist-test-slave-fbl4 krb5kdc[2274](info): commencing operation
krb5kdc: starting...
W20260619 02:49:00.026785 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:49:00 dist-test-slave-fbl4 krb5kdc[2274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:49:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:49:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:49:00.137658 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45203
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:41793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:45203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:49:00.218007 2287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:00.218254 2287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:00.218295 2287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:00.219581 2287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:00.219717 2287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:00.219795 2287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:00.219825 2287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:00.219852 2287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:00.221441 2287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:41793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:45203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:45203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:00.221704 2287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:00.221917 2287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:00.226600 2295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:00.226615 2293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:00.226615 2292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:00.226853 2287 server_base.cc:1034] running on GCE node
I20260619 02:49:00.227087 2287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:00.227355 2287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:00.228502 2287 hybrid_clock.cc:648] HybridClock initialized: now 1781837340228488 us; error 29 us; skew 500 ppm
Jun 19 02:49:00 dist-test-slave-fbl4 krb5kdc[2274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837340, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:00.230837 2287 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:49:00.231343 2287 webserver.cc:460] Webserver started at http://127.12.145.126:36905/ using document root <none> and password file <none>
I20260619 02:49:00.231572 2287 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:00.231635 2287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:00.231781 2287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:00.232782 2287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "8eb2d802d20a402bb7b1e879e549b0f2"
format_stamp: "Formatted at 2026-06-19 02:49:00 on dist-test-slave-fbl4"
server_key: "49b9224fb5c54dc1498ac896dc70bc51"
server_key_iv: "8f6adb6f96f04d62e12b294375261785"
server_key_version: "encryptionkey@0"
I20260619 02:49:00.233134 2287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "8eb2d802d20a402bb7b1e879e549b0f2"
format_stamp: "Formatted at 2026-06-19 02:49:00 on dist-test-slave-fbl4"
server_key: "49b9224fb5c54dc1498ac896dc70bc51"
server_key_iv: "8f6adb6f96f04d62e12b294375261785"
server_key_version: "encryptionkey@0"
I20260619 02:49:00.234403 2287 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:49:00.235154 2302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:00.235343 2287 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:49:00.235435 2287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "8eb2d802d20a402bb7b1e879e549b0f2"
format_stamp: "Formatted at 2026-06-19 02:49:00 on dist-test-slave-fbl4"
server_key: "49b9224fb5c54dc1498ac896dc70bc51"
server_key_iv: "8f6adb6f96f04d62e12b294375261785"
server_key_version: "encryptionkey@0"
I20260619 02:49:00.235514 2287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:00.249938 2287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:00.251745 2287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:00.251894 2287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:00.255695 2287 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:45203
I20260619 02:49:00.255725 2354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:45203 every 8 connection(s)
I20260619 02:49:00.256050 2287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:49:00.256839 2355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:00.259020 2355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2: Bootstrap starting.
I20260619 02:49:00.259500 2355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:00.259753 2355 log.cc:824] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:00.260406 2355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2: No bootstrap required, opened a new log
I20260619 02:49:00.261650 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2287
I20260619 02:49:00.261762 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:49:00.261927 12869 external_mini_cluster.cc:1428] Setting key 639308659fef67eb63a0e2bcf65a967b
I20260619 02:49:00.262245 2355 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45203 } }
I20260619 02:49:00.262458 2355 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:49:00.262598 2355 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eb2d802d20a402bb7b1e879e549b0f2, State: Initialized, Role: FOLLOWER
I20260619 02:49:00.262799 2355 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45203 } }
I20260619 02:49:00.262867 2355 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:49:00.262888 2355 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:49:00.262955 2355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:49:00.263466 2355 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45203 } }
I20260619 02:49:00.263585 2355 leader_election.cc:302] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eb2d802d20a402bb7b1e879e549b0f2; no voters:
I20260619 02:49:00.263767 2355 leader_election.cc:288] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:49:00.263794 2360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:49:00.263895 2360 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8eb2d802d20a402bb7b1e879e549b0f2, State: Running, Role: LEADER
I20260619 02:49:00.264016 2355 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:00.264020 2360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45203 } }
I20260619 02:49:00.264424 2360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8eb2d802d20a402bb7b1e879e549b0f2. Latest consensus state: current_term: 1 leader_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45203 } } }
I20260619 02:49:00.264433 2361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eb2d802d20a402bb7b1e879e549b0f2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 45203 } } }
I20260619 02:49:00.264559 2361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:00.264782 2360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:00.264799 2365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:49:00.265416 2365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:49:00.267951 2365 catalog_manager.cc:1347] Generated new cluster ID: 345794c5a41f47d6b6282fb0707cf75f
I20260619 02:49:00.267998 2365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 19 02:49:00 dist-test-slave-fbl4 krb5kdc[2274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:00.273211 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:00.262464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56903 (local address 127.12.145.126:45203)
0619 02:49:00.262706 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:00.262713 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:00.262738 (+ 25us) server_negotiation.cc:407] Connection header received
0619 02:49:00.262878 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:00.262884 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:00.262983 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:00.263127 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:00.264090 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:00.265440 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:00.266273 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:00.266884 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:00.266984 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:00.269682 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:00.269686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:00.269686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:00.269697 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:00.271477 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:00.271841 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:00.271845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:00.271845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:00.271967 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:00.272171 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:00.272172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:00.272172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:00.272472 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:00.272594 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:00.272847 (+ 253us) server_negotiation.cc:299] Negotiation successful
0619 02:49:00.273016 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":158,"threads_started":1}
I20260619 02:49:00.274430 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:49:00.274921 2365 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:49:00.275375 2365 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:49:00.285356 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:00.275903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58769 (local address 127.12.145.126:45203)
0619 02:49:00.275937 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:00.275939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:00.278756 (+ 2817us) server_negotiation.cc:407] Connection header received
0619 02:49:00.278816 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:00.278817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:00.278825 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:00.278878 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:00.279427 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:00.280175 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:00.281246 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:00.281537 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:00.281591 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:00.282862 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:00.282863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:00.282863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:00.282869 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:00.284287 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:00.284647 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:00.284648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:00.284648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:00.284716 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:00.284898 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:00.284898 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:00.284898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:00.285005 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:00.285100 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:00.285210 (+ 110us) server_negotiation.cc:299] Negotiation successful
0619 02:49:00.285273 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:49:00.288934 2365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8eb2d802d20a402bb7b1e879e549b0f2: Generated new TSK 0
I20260619 02:49:00.289119 2365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:49:00.292754 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2287
2026-06-19T02:49:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1292 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:49:00 dist-test-slave-fbl4 krb5kdc[2386](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:49:00 dist-test-slave-fbl4 krb5kdc[2386](info): set up 2 sockets
Jun 19 02:49:00 dist-test-slave-fbl4 krb5kdc[2386](info): commencing operation
krb5kdc: starting...
W20260619 02:49:01.322789 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:49:01 dist-test-slave-fbl4 krb5kdc[2386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:49:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:49:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:49:01.437712 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:42877
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:37833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:42877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:49:01.517733 2399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:01.517954 2399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:01.517992 2399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:01.519193 2399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:01.519253 2399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:01.519279 2399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:01.519309 2399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:01.519333 2399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:01.520763 2399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:37833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:42877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:42877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:01.521068 2399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:01.521283 2399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:01.525806 2404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:01.525832 2407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:01.525839 2405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:01.526129 2399 server_base.cc:1034] running on GCE node
I20260619 02:49:01.526357 2399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:01.526677 2399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:01.527819 2399 hybrid_clock.cc:648] HybridClock initialized: now 1781837341527806 us; error 28 us; skew 500 ppm
Jun 19 02:49:01 dist-test-slave-fbl4 krb5kdc[2386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837341, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:01.530313 2399 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:49:01.530786 2399 webserver.cc:460] Webserver started at http://127.12.145.126:43221/ using document root <none> and password file <none>
I20260619 02:49:01.531039 2399 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:01.531085 2399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:01.531422 2399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:01.532634 2399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c"
format_stamp: "Formatted at 2026-06-19 02:49:01 on dist-test-slave-fbl4"
server_key: "69dfbbfe24a04610d2415314e48bc4d2"
server_key_iv: "2c2716d61b296b71b493f5ad420b4f86"
server_key_version: "encryptionkey@0"
I20260619 02:49:01.533028 2399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c"
format_stamp: "Formatted at 2026-06-19 02:49:01 on dist-test-slave-fbl4"
server_key: "69dfbbfe24a04610d2415314e48bc4d2"
server_key_iv: "2c2716d61b296b71b493f5ad420b4f86"
server_key_version: "encryptionkey@0"
I20260619 02:49:01.534314 2399 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:49:01.535080 2414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:01.535245 2399 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:01.535326 2399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c"
format_stamp: "Formatted at 2026-06-19 02:49:01 on dist-test-slave-fbl4"
server_key: "69dfbbfe24a04610d2415314e48bc4d2"
server_key_iv: "2c2716d61b296b71b493f5ad420b4f86"
server_key_version: "encryptionkey@0"
I20260619 02:49:01.535377 2399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:01.557796 2399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:01.560115 2399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:01.560225 2399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:01.563951 2399 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:42877
I20260619 02:49:01.564011 2466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:42877 every 8 connection(s)
I20260619 02:49:01.564339 2399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:49:01.565239 2467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:01.567480 2467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c: Bootstrap starting.
I20260619 02:49:01.568035 2467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:01.568313 2467 log.cc:824] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:01.568958 2467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c: No bootstrap required, opened a new log
I20260619 02:49:01.570520 2467 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42877 } }
I20260619 02:49:01.570720 2467 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:49:01.570767 2467 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a65c3e28e4e4f8e829626c3e1f3c17c, State: Initialized, Role: FOLLOWER
I20260619 02:49:01.570905 2467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42877 } }
I20260619 02:49:01.570986 2467 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:49:01.571030 2467 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:49:01.571080 2467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:49:01.571874 2467 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42877 } }
I20260619 02:49:01.571993 2467 leader_election.cc:302] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a65c3e28e4e4f8e829626c3e1f3c17c; no voters:
I20260619 02:49:01.572161 2467 leader_election.cc:288] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:49:01.572214 2470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:49:01.572335 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2399
I20260619 02:49:01.572359 2470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [term 1 LEADER]: Becoming Leader. State: Replica: 7a65c3e28e4e4f8e829626c3e1f3c17c, State: Running, Role: LEADER
I20260619 02:49:01.572407 2467 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:01.572434 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:49:01.572454 2470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42877 } }
I20260619 02:49:01.572667 12869 external_mini_cluster.cc:1428] Setting key 43f591d40e8a6c3af86b793ecea1eef8
I20260619 02:49:01.572826 2470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a65c3e28e4e4f8e829626c3e1f3c17c. Latest consensus state: current_term: 1 leader_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42877 } } }
I20260619 02:49:01.572839 2471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a65c3e28e4e4f8e829626c3e1f3c17c" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 42877 } } }
I20260619 02:49:01.572999 2470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:01.573032 2471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c [sys.catalog]: This master's current role is: LEADER
W20260619 02:49:01.574460 2487 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:49:01.574514 2487 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:49:01.574599 2479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:49:01.574771 2479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:49:01.576134 2479 catalog_manager.cc:1347] Generated new cluster ID: cd778139fa3c419dbf63a62f7f27f47c
I20260619 02:49:01.576184 2479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:49:01.578486 2482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:01.573331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37785 (local address 127.12.145.126:42877)
0619 02:49:01.573503 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:01.573513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:01.573550 (+ 37us) server_negotiation.cc:407] Connection header received
0619 02:49:01.573669 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:01.573676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:01.573734 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:01.573867 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:01.574096 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:01.575383 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:01.576470 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:01.577052 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:01.577146 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:01.577817 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:01.577820 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:01.577820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:49:01.578012 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:01.578056 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:49:01.578069 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:01.578126 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:01.578233 (+ 107us) server_negotiation.cc:299] Negotiation successful
0619 02:49:01.578293 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260619 02:49:01.579402 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:49:01.584115 2482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:01.580804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59011 (local address 127.12.145.126:42877)
0619 02:49:01.580840 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:01.580842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:01.580989 (+ 147us) server_negotiation.cc:407] Connection header received
0619 02:49:01.581052 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:01.581053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:01.581062 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:01.581103 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:01.581227 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:01.581914 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:01.582910 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:01.583187 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:01.583242 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:01.583879 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:01.583880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:01.583881 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:49:01.583884 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:01.583897 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:49:01.583901 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:01.583942 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:01.584024 (+ 82us) server_negotiation.cc:299] Negotiation successful
0619 02:49:01.584045 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:49:01.591161 2479 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:49:01.591775 2479 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:49:01.597935 2479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a65c3e28e4e4f8e829626c3e1f3c17c: Generated new TSK 0
I20260619 02:49:01.598107 2479 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:49:01.603911 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2399
2026-06-19T02:49:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1311 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:49:01 dist-test-slave-fbl4 krb5kdc[2498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:49:01 dist-test-slave-fbl4 krb5kdc[2498](info): set up 2 sockets
Jun 19 02:49:01 dist-test-slave-fbl4 krb5kdc[2498](info): commencing operation
krb5kdc: starting...
W20260619 02:49:02.638813 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:49:02 dist-test-slave-fbl4 krb5kdc[2498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:49:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:49:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:49:02.754868 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33241
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:42183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:33241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:49:02.833170 2511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:02.833393 2511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:02.833429 2511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:02.834594 2511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:02.834656 2511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:02.834678 2511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:02.834699 2511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:02.834736 2511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:02.836174 2511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:42183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:33241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:02.836431 2511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:02.836644 2511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:02.841267 2516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:02.841244 2517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:02.841447 2511 server_base.cc:1034] running on GCE node
W20260619 02:49:02.841233 2519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:02.841784 2511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:02.842082 2511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:02.843235 2511 hybrid_clock.cc:648] HybridClock initialized: now 1781837342843214 us; error 33 us; skew 500 ppm
Jun 19 02:49:02 dist-test-slave-fbl4 krb5kdc[2498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837342, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:02.849838 2511 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:49:02.850304 2511 webserver.cc:460] Webserver started at http://127.12.145.126:33959/ using document root <none> and password file <none>
I20260619 02:49:02.850519 2511 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:02.850603 2511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:02.850749 2511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:02.851775 2511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "477510b22da1406aa9b1a910551de05e"
format_stamp: "Formatted at 2026-06-19 02:49:02 on dist-test-slave-fbl4"
server_key: "8fdb5dc3df5fb349a3e3528efc64700c"
server_key_iv: "e424df60889033c9a9d750f09d334a93"
server_key_version: "encryptionkey@0"
I20260619 02:49:02.852162 2511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "477510b22da1406aa9b1a910551de05e"
format_stamp: "Formatted at 2026-06-19 02:49:02 on dist-test-slave-fbl4"
server_key: "8fdb5dc3df5fb349a3e3528efc64700c"
server_key_iv: "e424df60889033c9a9d750f09d334a93"
server_key_version: "encryptionkey@0"
I20260619 02:49:02.853487 2511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:49:02.854213 2526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:02.854372 2511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:49:02.854470 2511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "477510b22da1406aa9b1a910551de05e"
format_stamp: "Formatted at 2026-06-19 02:49:02 on dist-test-slave-fbl4"
server_key: "8fdb5dc3df5fb349a3e3528efc64700c"
server_key_iv: "e424df60889033c9a9d750f09d334a93"
server_key_version: "encryptionkey@0"
I20260619 02:49:02.854547 2511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:02.857790 2511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:02.860641 2511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:02.860776 2511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:02.865644 2511 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:33241
I20260619 02:49:02.865674 2578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:33241 every 8 connection(s)
I20260619 02:49:02.865996 2511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:49:02.866847 2579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:02.868886 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2511
I20260619 02:49:02.868995 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:49:02.869184 12869 external_mini_cluster.cc:1428] Setting key a5f177e9f575996389c978a4d64e5a26
I20260619 02:49:02.869386 2579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e: Bootstrap starting.
I20260619 02:49:02.870018 2579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:02.870299 2579 log.cc:824] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:02.871057 2579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e: No bootstrap required, opened a new log
I20260619 02:49:02.871659 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:02.869653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34249 (local address 127.12.145.126:33241)
0619 02:49:02.869851 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:02.869860 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:02.869894 (+ 34us) server_negotiation.cc:407] Connection header received
0619 02:49:02.870336 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:02.870343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:02.870367 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:02.870515 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:02.871241 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:02.871244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:02.871244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:49:02.871249 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:02.871290 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:49:02.871303 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:02.871393 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:02.871421 (+ 28us) server_negotiation.cc:299] Negotiation successful
0619 02:49:02.871459 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260619 02:49:02.872546 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:49:02.873509 2579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477510b22da1406aa9b1a910551de05e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33241 } }
I20260619 02:49:02.873710 2579 raft_consensus.cc:374] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 02:49:02.873785 2579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 477510b22da1406aa9b1a910551de05e, State: Initialized, Role: FOLLOWER
I20260619 02:49:02.873929 2579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477510b22da1406aa9b1a910551de05e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33241 } }
I20260619 02:49:02.874029 2579 raft_consensus.cc:388] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 02:49:02.874099 2579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 02:49:02.874189 2579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:49:02.874934 2579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477510b22da1406aa9b1a910551de05e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33241 } }
I20260619 02:49:02.875051 2579 leader_election.cc:302] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 477510b22da1406aa9b1a910551de05e; no voters:
I20260619 02:49:02.875207 2579 leader_election.cc:288] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 02:49:02.875231 2589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:49:02.875411 2589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [term 1 LEADER]: Becoming Leader. State: Replica: 477510b22da1406aa9b1a910551de05e, State: Running, Role: LEADER
I20260619 02:49:02.875538 2579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:02.875528 2589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477510b22da1406aa9b1a910551de05e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33241 } }
I20260619 02:49:02.875896 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:02.873948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54493 (local address 127.12.145.126:33241)
0619 02:49:02.873988 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:02.873989 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:02.874087 (+ 98us) server_negotiation.cc:407] Connection header received
0619 02:49:02.874148 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:02.874149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:02.874153 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:02.874215 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:02.875659 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:02.875660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:02.875660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 02:49:02.875664 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:02.875675 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 02:49:02.875679 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:02.875706 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:02.875825 (+ 119us) server_negotiation.cc:299] Negotiation successful
0619 02:49:02.875839 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:49:02.877063 2589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 477510b22da1406aa9b1a910551de05e. Latest consensus state: current_term: 1 leader_uuid: "477510b22da1406aa9b1a910551de05e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477510b22da1406aa9b1a910551de05e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33241 } } }
I20260619 02:49:02.877267 2589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:02.877380 2591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "477510b22da1406aa9b1a910551de05e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "477510b22da1406aa9b1a910551de05e" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33241 } } }
I20260619 02:49:02.877797 2604 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:49:02.877866 2591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:02.878345 2604 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:49:02.880066 2604 catalog_manager.cc:1347] Generated new cluster ID: 6e9132d358ee4f49a755c145c6e04198
I20260619 02:49:02.880115 2604 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:49:02.887568 2604 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:49:02.887714 2604 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:49:02.891769 2604 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 477510b22da1406aa9b1a910551de05e: Generated new TSK 0
I20260619 02:49:02.891922 2604 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 02:49:02.895680 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2511
2026-06-19T02:49:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1291 ms)
[----------] 18 tests from AuthTokenIssuingTest (23462 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:49:02 dist-test-slave-fbl4 krb5kdc[2610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:49:02 dist-test-slave-fbl4 krb5kdc[2610](info): set up 2 sockets
Jun 19 02:49:02 dist-test-slave-fbl4 krb5kdc[2610](info): commencing operation
krb5kdc: starting...
W20260619 02:49:03.926851 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:49:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:49:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:49:04.043102 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33495
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:43355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:33495,127.12.145.125:34201,127.12.145.124:36719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:49:04.133637 2623 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 02:49:04.133906 2623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:04.133941 2623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:04.133988 2623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:04.135293 2623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:04.135383 2623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:04.135425 2623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:04.135457 2623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:04.135492 2623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:04.137105 2623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:43355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:33495,127.12.145.125:34201,127.12.145.124:36719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:33495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:04.137408 2623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:04.137673 2623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:04.142578 2631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:04.142709 2623 server_base.cc:1034] running on GCE node
W20260619 02:49:04.142581 2629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:04.142792 2628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:04.143060 2623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:04.143389 2623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:04.144546 2623 hybrid_clock.cc:648] HybridClock initialized: now 1781837344144532 us; error 29 us; skew 500 ppm
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:04.146957 2623 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:49:04.147413 2623 webserver.cc:460] Webserver started at http://127.12.145.126:36819/ using document root <none> and password file <none>
I20260619 02:49:04.147611 2623 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:04.147699 2623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:04.147809 2623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:04.148852 2623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "91554cbf156e43038511828d54bb54d2"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "80ef51b121ed96f03bcc2f9acf6d04f3"
server_key_iv: "d53dee00b900512f2b641813cfa5fd4f"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.149152 2623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "91554cbf156e43038511828d54bb54d2"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "80ef51b121ed96f03bcc2f9acf6d04f3"
server_key_iv: "d53dee00b900512f2b641813cfa5fd4f"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.150370 2623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260619 02:49:04.151113 2638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:04.151280 2623 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:04.151386 2623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "91554cbf156e43038511828d54bb54d2"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "80ef51b121ed96f03bcc2f9acf6d04f3"
server_key_iv: "d53dee00b900512f2b641813cfa5fd4f"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.151461 2623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:04.165438 2623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:04.167280 2623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:04.167441 2623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:04.171679 2623 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:33495
I20260619 02:49:04.171710 2690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:33495 every 8 connection(s)
I20260619 02:49:04.172068 2623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:49:04.172940 2691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:04.174463 2691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:04.178236 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2623
I20260619 02:49:04.178361 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:49:04.178581 12869 external_mini_cluster.cc:1428] Setting key aac57b9b0bc7bcda11e605b0e5472ed9
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:04.184147 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.175154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33495 (local address 127.0.0.1:54690)
0619 02:49:04.175291 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.175341 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.175779 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.176028 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.176030 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.176265 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.176415 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.176419 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.177381 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.177382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.178092 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.178094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.178713 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.178714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.178779 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.179326 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.179334 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.180697 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.182650 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.182656 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.182658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.182865 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.183129 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.183130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.183130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.183219 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.183559 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.183564 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.183623 (+ 59us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.183732 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.183967 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":94,"thread_start_us":62,"threads_started":1}
I20260619 02:49:04.184149 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.175208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54690 (local address 127.12.145.126:33495)
0619 02:49:04.175370 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.175374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.175403 (+ 29us) server_negotiation.cc:407] Connection header received
0619 02:49:04.175901 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.175903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.175918 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.176015 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.176494 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.177299 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.178175 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.178595 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.178721 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.180799 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.180806 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.180806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.180817 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.182522 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.182959 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.182961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.182962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.183039 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.183284 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.183285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.183285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.183489 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.183579 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.183765 (+ 186us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.183921 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260619 02:49:04.184808 2691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:04.185173 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.185064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49436)
0619 02:49:04.185112 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.185153 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260619 02:49:04.185295 2642 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.145.125@KRBTEST.COM; defaulting to no policy
I20260619 02:49:04.185658 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.185585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49450)
0619 02:49:04.185613 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.185636 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260619 02:49:04.185760 2691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:34201: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab.
Entry for principal kudu/127.12.145.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab.
I20260619 02:49:04.201704 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:34201
--webserver_interface=127.12.145.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab
--principal=kudu/127.12.145.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:43355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:33495,127.12.145.125:34201,127.12.145.124:36719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:49:04.234987 2691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } attempt: 1
I20260619 02:49:04.235499 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.235358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49452)
0619 02:49:04.235435 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.235468 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260619 02:49:04.235831 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.235737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49460)
0619 02:49:04.235783 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.235807 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260619 02:49:04.235913 2691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:34201: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
W20260619 02:49:04.282287 2698 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 02:49:04.282545 2698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:04.282603 2698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:04.282660 2698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:04.283871 2698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:04.283975 2698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:04.284003 2698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:04.284032 2698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:04.284058 2698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:04.285527 2698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:43355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:33495,127.12.145.125:34201,127.12.145.124:36719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab
--principal=kudu/127.12.145.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:34201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:04.285815 2698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:04.286049 2698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:04.291033 2704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:04.291154 2698 server_base.cc:1034] running on GCE node
W20260619 02:49:04.291002 2703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:04.291018 2706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:04.291469 2698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:04.291813 2698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:04.292981 2698 hybrid_clock.cc:648] HybridClock initialized: now 1781837344292958 us; error 37 us; skew 500 ppm
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:04.295476 2698 init.cc:377] Logged in from keytab as kudu/127.12.145.125@KRBTEST.COM (short username kudu)
I20260619 02:49:04.295917 2698 webserver.cc:460] Webserver started at http://127.12.145.125:36989/ using document root <none> and password file <none>
I20260619 02:49:04.296150 2698 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:04.296216 2698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:04.296356 2698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:04.297403 2698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data/instance:
uuid: "5afed2baf0e44cae89fff6354d07cf48"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "3b3fea1f468a92767dde00213b0d17fe"
server_key_iv: "968ef220f985706ad36ab669fa0d5cf1"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.297766 2698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/wal/instance:
uuid: "5afed2baf0e44cae89fff6354d07cf48"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "3b3fea1f468a92767dde00213b0d17fe"
server_key_iv: "968ef220f985706ad36ab669fa0d5cf1"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.299192 2698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:49:04.299942 2713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:04.300120 2698 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:49:04.300238 2698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/wal
uuid: "5afed2baf0e44cae89fff6354d07cf48"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "3b3fea1f468a92767dde00213b0d17fe"
server_key_iv: "968ef220f985706ad36ab669fa0d5cf1"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.300309 2698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:04.304044 2691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } attempt: 2
I20260619 02:49:04.304430 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.304312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49462)
0619 02:49:04.304365 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.304401 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260619 02:49:04.304735 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.304662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49470)
0619 02:49:04.304697 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.304719 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260619 02:49:04.304850 2691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:34201: Network error: Client connection negotiation failed: client connection to 127.12.145.125:34201: connect: Connection refused (error 111)
I20260619 02:49:04.332401 2698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:04.334466 2698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:04.334667 2698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:04.338373 2698 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.125:34201
I20260619 02:49:04.338439 2765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.125:34201 every 8 connection(s)
I20260619 02:49:04.338795 2698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
I20260619 02:49:04.339660 2766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:04.341126 2766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:04.346700 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2698
I20260619 02:49:04.346808 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-1/wal/instance
I20260619 02:49:04.347047 12869 external_mini_cluster.cc:1428] Setting key 1115c0356ca0b85c57f42a0b11273dd4
I20260619 02:49:04.350180 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.341790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54704 (local address 127.12.145.126:33495)
0619 02:49:04.341857 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.341859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.342110 (+ 251us) server_negotiation.cc:407] Connection header received
0619 02:49:04.342517 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.342518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.342537 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.342657 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.343254 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.343745 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.344686 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.344881 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.344932 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.347031 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.347033 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.347033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.347041 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.348707 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.349230 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.349231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.349231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.349281 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.349583 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.349583 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.349583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.349683 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.349731 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.350052 (+ 321us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.350116 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260619 02:49:04.350528 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.341765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33495 (local address 127.0.0.1:54704)
0619 02:49:04.341928 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.341970 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.342431 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.342726 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.342729 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.342974 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.343172 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.343176 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.343831 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.343832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.344610 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.344612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.344958 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.344959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.345079 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.345512 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.345520 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.346917 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.348805 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.348812 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.348815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.349147 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.349346 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.349347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.349347 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.349513 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.349749 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.349755 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.349920 (+ 165us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.350036 (+ 116us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.350222 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260619 02:49:04.351248 2766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.145.124@KRBTEST.COM; defaulting to no policy
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.124@KRBTEST.COM" created.
I20260619 02:49:04.359014 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.351545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49484)
0619 02:49:04.351592 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.351602 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.351643 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.351863 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.351865 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.352026 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.352092 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.352094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.352929 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.352930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.353783 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.353785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.354418 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.354419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.354506 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.354897 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.354902 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.356233 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.357849 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.357850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.357850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.358064 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.358308 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.358309 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.358310 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.358368 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.358703 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.358704 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.358741 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.358806 (+ 65us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.358902 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260619 02:49:04.359088 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.351602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49484 (local address 127.12.145.125:34201)
0619 02:49:04.351740 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.351744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.351757 (+ 13us) server_negotiation.cc:407] Connection header received
0619 02:49:04.351771 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.351773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.351782 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.351832 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.352177 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.352835 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.353868 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.354335 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.354391 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.356310 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.356317 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.356317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.356323 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.357760 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.358154 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.358157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.358157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.358231 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.358440 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.358441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.358441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.358637 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.358726 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.358832 (+ 106us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.358953 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":117,"thread_start_us":92,"threads_started":1}
I20260619 02:49:04.359584 2766 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:04.359946 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.359804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42070)
0619 02:49:04.359856 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.359912 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260619 02:49:04.360093 2717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
I20260619 02:49:04.360520 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.360409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42076)
0619 02:49:04.360467 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.360500 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260619 02:49:04.360637 2766 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:36719: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab.
Entry for principal kudu/127.12.145.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab.
I20260619 02:49:04.371641 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:36719
--webserver_interface=127.12.145.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab
--principal=kudu/127.12.145.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:43355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:33495,127.12.145.125:34201,127.12.145.124:36719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:49:04.396219 2691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } attempt: 3
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:49:04.403484 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.396800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49492 (local address 127.12.145.125:34201)
0619 02:49:04.396871 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.396873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.396884 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:49:04.396976 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.396977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.396988 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.397054 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.397392 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.397888 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.398627 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.398848 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.398960 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.400788 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.400789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.400790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.400798 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.402225 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.402688 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.402689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.402689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.402754 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.402955 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.402956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.402956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.403078 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.403156 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.403306 (+ 150us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.403384 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260619 02:49:04.403484 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.396732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49492)
0619 02:49:04.396788 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.396808 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.396879 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.397059 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.397060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.397241 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.397306 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.397308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.397989 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.397990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.398527 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.398528 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.398951 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.398952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.399034 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.399538 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.399542 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.400699 (+ 1157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.402340 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.402341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.402342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.402581 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.402824 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.402824 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.402825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.402887 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.403148 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.403149 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.403206 (+ 57us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.403282 (+ 76us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.403382 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260619 02:49:04.403860 2691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:04.404224 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.404104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42092)
0619 02:49:04.404156 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.404195 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260619 02:49:04.404639 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.404487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42104)
0619 02:49:04.404582 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.404614 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260619 02:49:04.404753 2691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:36719: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
I20260619 02:49:04.409868 2766 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } attempt: 1
I20260619 02:49:04.410291 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.410168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42120)
0619 02:49:04.410226 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.410264 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260619 02:49:04.410658 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.410582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42128)
0619 02:49:04.410611 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.410638 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260619 02:49:04.410766 2766 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:36719: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
I20260619 02:49:04.435889 2691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } attempt: 1
I20260619 02:49:04.436408 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.436273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42144)
0619 02:49:04.436341 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.436381 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260619 02:49:04.436784 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.436700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42148)
0619 02:49:04.436742 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.436766 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260619 02:49:04.436904 2691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:36719: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
W20260619 02:49:04.453760 2773 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 02:49:04.454023 2773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:04.454053 2773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:04.454113 2773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:04.455379 2773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:04.455418 2773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:04.455435 2773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:04.455448 2773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:04.455480 2773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:04.456956 2773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:43355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:33495,127.12.145.125:34201,127.12.145.124:36719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab
--principal=kudu/127.12.145.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:36719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:04.457201 2773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:04.457448 2773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:04.462119 2779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:04.462179 2778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:04.462121 2781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:04.462391 2773 server_base.cc:1034] running on GCE node
I20260619 02:49:04.462666 2773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:04.462911 2773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:04.464113 2773 hybrid_clock.cc:648] HybridClock initialized: now 1781837344464092 us; error 34 us; skew 500 ppm
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:04.466534 2773 init.cc:377] Logged in from keytab as kudu/127.12.145.124@KRBTEST.COM (short username kudu)
I20260619 02:49:04.467038 2773 webserver.cc:460] Webserver started at http://127.12.145.124:36349/ using document root <none> and password file <none>
I20260619 02:49:04.467264 2773 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:04.467347 2773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:04.467504 2773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:04.468555 2773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data/instance:
uuid: "9eaadf3ac8b9422d83783e82830157c4"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "58f60edfca271594838411244e174cfa"
server_key_iv: "8d367c6b7afdac2b364f2a892713421b"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.468914 2773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/wal/instance:
uuid: "9eaadf3ac8b9422d83783e82830157c4"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "58f60edfca271594838411244e174cfa"
server_key_iv: "8d367c6b7afdac2b364f2a892713421b"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.470186 2773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260619 02:49:04.470983 2789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:04.471156 2773 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:04.471249 2773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/wal
uuid: "9eaadf3ac8b9422d83783e82830157c4"
format_stamp: "Formatted at 2026-06-19 02:49:04 on dist-test-slave-fbl4"
server_key: "58f60edfca271594838411244e174cfa"
server_key_iv: "8d367c6b7afdac2b364f2a892713421b"
server_key_version: "encryptionkey@0"
I20260619 02:49:04.471323 2773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:04.478914 2766 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } attempt: 2
I20260619 02:49:04.479316 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.479182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42154)
0619 02:49:04.479240 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.479280 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260619 02:49:04.479663 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.479575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42158)
0619 02:49:04.479626 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.479648 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260619 02:49:04.479792 2766 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:36719: Network error: Client connection negotiation failed: client connection to 127.12.145.124:36719: connect: Connection refused (error 111)
I20260619 02:49:04.485596 2773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:04.487844 2773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:04.488015 2773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:04.491987 2773 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.124:36719
I20260619 02:49:04.492013 2841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.124:36719 every 8 connection(s)
I20260619 02:49:04.492360 2773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
I20260619 02:49:04.493219 2842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:04.494781 2842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:04.495800 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 2773
I20260619 02:49:04.495898 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781837054956172-12869-0/minicluster-data/master-2/wal/instance
I20260619 02:49:04.496085 12869 external_mini_cluster.cc:1428] Setting key 72dc24f5e00d3fbea9ae3b0e643d66d0
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
I20260619 02:49:04.504416 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.495479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54720 (local address 127.12.145.126:33495)
0619 02:49:04.495539 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.495542 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.495744 (+ 202us) server_negotiation.cc:407] Connection header received
0619 02:49:04.496407 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.496408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.496420 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.496487 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.497240 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.497723 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.498803 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.499037 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.499113 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.501331 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.501332 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.501332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.501338 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.503046 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.503400 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.503401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.503402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.503460 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.503682 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.503683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.503683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.503827 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.503894 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.504220 (+ 326us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.504306 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:49:04.504590 2844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.495474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:33495 (local address 127.0.0.1:54720)
0619 02:49:04.495628 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.495664 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.496304 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.496560 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.496565 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.496944 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.497150 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.497155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.497813 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.497814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.498708 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.498710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.499130 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.499131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.499260 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.499756 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.499766 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.501251 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.503120 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.503125 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.503127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.503326 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.503530 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.503530 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.503531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.503618 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.503900 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.503906 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.504056 (+ 150us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.504166 (+ 110us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.504309 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":123,"thread_start_us":75,"threads_started":1}
I20260619 02:49:04.505091 2842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:04.505218 2845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.496466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42174 (local address 127.12.145.124:36719)
0619 02:49:04.496631 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.496636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.496754 (+ 118us) server_negotiation.cc:407] Connection header received
0619 02:49:04.496792 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.496794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.496819 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.496899 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.497494 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.498281 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.499082 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.499373 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.499467 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.501935 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.501942 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.501943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.501950 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.503751 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.504182 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.504185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.504185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.504245 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.504449 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.504450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.504450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.504615 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.504782 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.505044 (+ 262us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.505119 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:04.512080 2691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } attempt: 2
I20260619 02:49:04.512372 2844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.505336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:34201 (local address 127.0.0.1:49496)
0619 02:49:04.505434 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.505442 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.505504 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.505810 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.505811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.505970 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.506019 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.506021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.506876 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.506877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.507556 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.507558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.508004 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.508005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.508051 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.508383 (+ 332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.508388 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.509502 (+ 1114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.511341 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.511342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.511342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.511506 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.511729 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.511730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.511730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.511788 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.512041 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.512042 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.512082 (+ 40us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.512210 (+ 128us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.512289 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260619 02:49:04.512370 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.505514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49496 (local address 127.12.145.125:34201)
0619 02:49:04.505577 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.505579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.505588 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:49:04.505613 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.505614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.505623 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.505682 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.506097 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.506813 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.507626 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.507934 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.508002 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.509579 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.509580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.509580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.509587 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.511265 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.511601 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.511602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.511603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.511663 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.511852 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.511853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.511853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.511959 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.512049 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.512198 (+ 149us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.512279 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:49:04.513100 2842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:04.513613 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.505969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54722 (local address 127.12.145.126:33495)
0619 02:49:04.506005 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.506007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.506017 (+ 10us) server_negotiation.cc:407] Connection header received
0619 02:49:04.506038 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.506039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.506047 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.506095 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.506671 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.507312 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.508144 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.508394 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.508462 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.510768 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.510769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.510770 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.510777 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.512325 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.512685 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.512686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.512686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.512746 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.512976 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.512977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.512977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.513094 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.513265 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.513490 (+ 225us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.513560 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:49:04.519840 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.512298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42190)
0619 02:49:04.512374 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.512384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.512416 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.512812 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.512813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.513003 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.513041 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.513043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.513910 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.513911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.514737 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.514740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.515194 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.515195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.515262 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.515638 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.515643 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.516965 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.518635 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.518636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.518637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.518802 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.519021 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.519022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.519022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.519079 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.519546 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.519547 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.519581 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.519654 (+ 73us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.519742 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 02:49:04.519884 2845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.512504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42190 (local address 127.12.145.124:36719)
0619 02:49:04.512714 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.512715 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.512722 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:49:04.512740 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.512740 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.512750 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.512803 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.513124 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.513835 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.514817 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.515121 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.515188 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.517027 (+ 1839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.517028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.517029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.517034 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.518529 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.518886 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.518887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.518887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.518945 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.519149 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.519150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.519150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.519252 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.519322 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.519693 (+ 371us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.519799 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191}
I20260619 02:49:04.521735 2691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2: Bootstrap starting.
I20260619 02:49:04.521907 2844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.513328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42198)
0619 02:49:04.513915 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.513924 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.513960 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.514189 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.514190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.514350 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.514381 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.514383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.515231 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.515231 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.515905 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.515907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.516330 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.516331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.516378 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.517065 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.517069 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.518570 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.521063 (+ 2493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.521064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.521064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.521214 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.521403 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.521403 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.521403 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.521453 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.521719 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.521719 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.521749 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.521798 (+ 49us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.521856 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576}
I20260619 02:49:04.522277 2847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.513377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42198 (local address 127.12.145.124:36719)
0619 02:49:04.513537 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.513538 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.513955 (+ 417us) server_negotiation.cc:407] Connection header received
0619 02:49:04.514083 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.514084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.514095 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.514157 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.514478 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.515160 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.515992 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.516255 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.516333 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.518655 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.518656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.518656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.518662 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.520985 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.521285 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.521286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.521286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.521342 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.521511 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.521512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.521512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.521653 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.521721 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.521874 (+ 153us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.522158 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
I20260619 02:49:04.522483 2691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:04.522818 2691 log.cc:824] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:04.523489 2842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: Bootstrap starting.
I20260619 02:49:04.523622 2691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2: No bootstrap required, opened a new log
I20260619 02:49:04.524121 2842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:04.524382 2842 log.cc:824] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:04.525146 2842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: No bootstrap required, opened a new log
I20260619 02:49:04.525306 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.514394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49498 (local address 127.12.145.125:34201)
0619 02:49:04.514427 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.514429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.514436 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:49:04.514463 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.514464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.514474 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.514536 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.515066 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.515712 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.516899 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.517218 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.517282 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.519810 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.519811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.519811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.519818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.524142 (+ 4324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.524486 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.524487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.524488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.524537 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.524771 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.524772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.524772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.524893 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.525070 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.525123 (+ 53us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.525191 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:49:04.525682 2691 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.525806 2691 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91554cbf156e43038511828d54bb54d2, State: Initialized, Role: FOLLOWER
I20260619 02:49:04.525877 2691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.526144 2850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.526199 2691 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:04.526232 2850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:04.526649 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:49:04.527410 2842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.527631 2842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eaadf3ac8b9422d83783e82830157c4, State: Initialized, Role: FOLLOWER
I20260619 02:49:04.527715 2842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.527622 2665 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "91554cbf156e43038511828d54bb54d2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54722
I20260619 02:49:04.528000 2842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:04.528014 2665 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 02:49:04.528065 2665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [term 0 FOLLOWER]: Advancing to term 1
W20260619 02:49:04.528306 2861 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:49:04.528360 2861 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:49:04.528977 2665 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.529248 2665 leader_election.cc:288] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [CANDIDATE]: Term 1 election: Requested vote from peers 5afed2baf0e44cae89fff6354d07cf48 (127.12.145.125:34201), 9eaadf3ac8b9422d83783e82830157c4 (127.12.145.124:36719)
W20260619 02:49:04.530055 2874 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:49:04.530115 2874 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:49:04.529479 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.529850 2816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "91554cbf156e43038511828d54bb54d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9eaadf3ac8b9422d83783e82830157c4"
I20260619 02:49:04.530284 2816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:49:04.531121 2816 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91554cbf156e43038511828d54bb54d2 in term 1.
I20260619 02:49:04.531267 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:04.530699 2623 master_runner.cc:186] Error getting master registration for 127.12.145.125:34201: OK, instance_id { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" instance_seqno: 1781837344337368 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 02:49:04.533257 2623 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 02:49:04.533550 2642 leader_election.cc:302] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91554cbf156e43038511828d54bb54d2, 9eaadf3ac8b9422d83783e82830157c4; no voters:
I20260619 02:49:04.533677 2850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:49:04.533833 2850 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [term 1 LEADER]: Becoming Leader. State: Replica: 91554cbf156e43038511828d54bb54d2, State: Running, Role: LEADER
I20260619 02:49:04.533921 2850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.534348 2850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91554cbf156e43038511828d54bb54d2. Latest consensus state: current_term: 1 leader_uuid: "91554cbf156e43038511828d54bb54d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.534443 2850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:04.535938 2773 master_runner.cc:186] Error getting master registration for 127.12.145.125:34201: OK, instance_id { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" instance_seqno: 1781837344337368 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 02:49:04.538067 2773 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 02:49:04.538676 2885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:49:04.538862 2885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:49:04.543778 2847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.533338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42202 (local address 127.12.145.124:36719)
0619 02:49:04.533371 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.533373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.533380 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:49:04.533400 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.533401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.533412 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.533482 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.534574 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.535263 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.539037 (+ 3774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.539348 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.539391 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.540787 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.540789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.540789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.540795 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.542443 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.542882 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.542883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.542883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.542936 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.543199 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.543200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.543200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.543317 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.543408 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.543612 (+ 204us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.543687 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260619 02:49:04.546191 2816 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [term 1 FOLLOWER]: Refusing update from remote peer 91554cbf156e43038511828d54bb54d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:49:04.546644 2850 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:49:04.546747 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.531172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49508 (local address 127.12.145.125:34201)
0619 02:49:04.531225 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.531227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.531720 (+ 493us) server_negotiation.cc:407] Connection header received
0619 02:49:04.531850 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.531851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.531873 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.531901 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.533062 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.533737 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.535224 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.535521 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.535564 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.543017 (+ 7453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.543018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.543018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.543036 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.544953 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.545554 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.545555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.545555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.545613 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.545843 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.545844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.545845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.545990 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.546055 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.546264 (+ 209us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.546339 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260619 02:49:04.547786 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91554cbf156e43038511828d54bb54d2. Latest consensus state: current_term: 1 leader_uuid: "91554cbf156e43038511828d54bb54d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.547879 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:04.550982 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.530887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.12.145.126:33495)
0619 02:49:04.530919 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.530920 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.531645 (+ 725us) server_negotiation.cc:407] Connection header received
0619 02:49:04.531742 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.531743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.531752 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.531779 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.532607 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.533270 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.540837 (+ 7567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.541417 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.541481 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.546160 (+ 4679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.546161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.546172 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.546179 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.549335 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.549952 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.549953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.549954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.550011 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.550306 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.550307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.550307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.550432 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.550576 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.550807 (+ 231us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.550887 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260619 02:49:04.552299 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "91554cbf156e43038511828d54bb54d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.552376 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:04.552675 2850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "91554cbf156e43038511828d54bb54d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.552753 2850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:04.552824 2886 mvcc.cc:205] Tried to move back new op lower bound from 7298405763252535296 to 7298405763211743232. Current Snapshot: MvccSnapshot[applied={T|T < 7298405763252535296}]
I20260619 02:49:04.552917 2887 mvcc.cc:205] Tried to move back new op lower bound from 7298405763252535296 to 7298405763211743232. Current Snapshot: MvccSnapshot[applied={T|T < 7298405763252535296}]
I20260619 02:49:04.553418 2885 catalog_manager.cc:1347] Generated new cluster ID: 060b37a460284f5193cb618953408ab6
I20260619 02:49:04.553479 2885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:49:04.570930 2766 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } attempt: 3
Jun 19 02:49:04 dist-test-slave-fbl4 krb5kdc[2610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837344, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
I20260619 02:49:04.578639 2768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.571194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:36719 (local address 127.0.0.1:42218)
0619 02:49:04.571239 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:04.571251 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:04.571289 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:04.571518 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:04.571519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:04.571722 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:04.571768 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.571771 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.572689 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.572690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.573504 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:04.573507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.573915 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.573915 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:04.573964 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.574396 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:04.574400 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:04.575818 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:04.577557 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.577559 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.577559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.577758 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.577961 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:04.577961 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:04.577962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:04.578023 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:04.578299 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:04.578300 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:04.578340 (+ 40us) client_negotiation.cc:769] Sending connection context
0619 02:49:04.578404 (+ 64us) client_negotiation.cc:240] Negotiation successful
0619 02:49:04.578506 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260619 02:49:04.578970 2847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:04.571274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.12.145.124:36719)
0619 02:49:04.571309 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.571311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.571318 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:49:04.571338 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.571339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.571347 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.571395 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.571850 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.572599 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.573574 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:04.573855 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:04.573918 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:04.575894 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:04.575895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:04.575896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:04.575902 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:04.577482 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.577834 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.577835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.577836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.577891 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:04.578091 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:04.578091 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:04.578092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:04.578217 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:04.578274 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:04.578816 (+ 542us) server_negotiation.cc:299] Negotiation successful
0619 02:49:04.578886 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:49:04.580446 2766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: Bootstrap starting.
I20260619 02:49:04.581154 2766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:04.581480 2766 log.cc:824] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:04.582382 2766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: No bootstrap required, opened a new log
I20260619 02:49:04.586232 2766 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.586371 2766 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5afed2baf0e44cae89fff6354d07cf48, State: Initialized, Role: FOLLOWER
I20260619 02:49:04.586455 2766 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } }
I20260619 02:49:04.586809 2766 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:04.586859 2740 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "91554cbf156e43038511828d54bb54d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5afed2baf0e44cae89fff6354d07cf48"
I20260619 02:49:04.587558 2739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:49:04.588012 2885 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:49:04.588425 2739 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [term 1 FOLLOWER]: Refusing update from remote peer 91554cbf156e43038511828d54bb54d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:49:04.588721 2885 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:49:04.588682 2850 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:49:04.589830 2740 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91554cbf156e43038511828d54bb54d2 in term 1.
I20260619 02:49:04.586786 2892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.593151 2892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:04.593254 2892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91554cbf156e43038511828d54bb54d2. Latest consensus state: current_term: 1 leader_uuid: "91554cbf156e43038511828d54bb54d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.593354 2892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:04.593434 2892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "91554cbf156e43038511828d54bb54d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.593732 2892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:04.594587 2883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "91554cbf156e43038511828d54bb54d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91554cbf156e43038511828d54bb54d2" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 33495 } } peers { permanent_uuid: "5afed2baf0e44cae89fff6354d07cf48" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 34201 } } peers { permanent_uuid: "9eaadf3ac8b9422d83783e82830157c4" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 36719 } } }
I20260619 02:49:04.594687 2883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:04.595048 2904 mvcc.cc:205] Tried to move back new op lower bound from 7298405763414540288 to 7298405763211743232. Current Snapshot: MvccSnapshot[applied={T|T < 7298405763252535296}]
I20260619 02:49:04.595294 2885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91554cbf156e43038511828d54bb54d2: Generated new TSK 0
I20260619 02:49:04.595458 2885 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 02:49:04.595628 2907 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:49:04.595691 2907 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260619 02:49:04.622059 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.620492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49522 (local address 127.12.145.125:34201)
0619 02:49:04.620534 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.620536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.621429 (+ 893us) server_negotiation.cc:407] Connection header received
0619 02:49:04.621531 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.621532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.621543 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.621574 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.621998 (+ 424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49522: BlockingRecv error: recv got EOF from 127.0.0.1:49522 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260619 02:49:04.623067 2847 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.620825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42230 (local address 127.12.145.124:36719)
0619 02:49:04.620864 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.620866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.622257 (+ 1391us) server_negotiation.cc:407] Connection header received
0619 02:49:04.622520 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.622521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.622531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.622579 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.623009 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42230: BlockingRecv error: recv got EOF from 127.0.0.1:42230 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260619 02:49:04.623515 2694 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.621129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54734 (local address 127.12.145.126:33495)
0619 02:49:04.621166 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.621168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.622385 (+ 1217us) server_negotiation.cc:407] Connection header received
0619 02:49:04.622641 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.622642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.622652 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.622680 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.623456 (+ 776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54734: BlockingRecv error: recv got EOF from 127.0.0.1:54734 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260619 02:49:04.625730 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.625000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49526 (local address 127.12.145.125:34201)
0619 02:49:04.625031 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.625033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.625244 (+ 211us) server_negotiation.cc:407] Connection header received
0619 02:49:04.625344 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.625345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.625361 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.625399 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.625687 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49526: BlockingRecv error: recv got EOF from 127.0.0.1:49526 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260619 02:49:04.628681 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.627861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49532 (local address 127.12.145.125:34201)
0619 02:49:04.627891 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.627892 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.628126 (+ 234us) server_negotiation.cc:407] Connection header received
0619 02:49:04.628262 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.628262 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.628272 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.628299 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.628641 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49532: BlockingRecv error: recv got EOF from 127.0.0.1:49532 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260619 02:49:04.632356 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.631666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.12.145.125:34201)
0619 02:49:04.631696 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.631698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.631912 (+ 214us) server_negotiation.cc:407] Connection header received
0619 02:49:04.632001 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.632002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.632011 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.632038 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.632316 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49544: BlockingRecv error: recv got EOF from 127.0.0.1:49544 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260619 02:49:04.637972 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.637279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49546 (local address 127.12.145.125:34201)
0619 02:49:04.637310 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.637311 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.637538 (+ 227us) server_negotiation.cc:407] Connection header received
0619 02:49:04.637624 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.637625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.637634 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.637660 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.637933 (+ 273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49546: BlockingRecv error: recv got EOF from 127.0.0.1:49546 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260619 02:49:04.647985 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.647136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.12.145.125:34201)
0619 02:49:04.647175 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.647177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.647445 (+ 268us) server_negotiation.cc:407] Connection header received
0619 02:49:04.647544 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.647544 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.647555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.647584 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.647917 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49554: BlockingRecv error: recv got EOF from 127.0.0.1:49554 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260619 02:49:04.666091 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.665194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.12.145.125:34201)
0619 02:49:04.665236 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.665239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.665522 (+ 283us) server_negotiation.cc:407] Connection header received
0619 02:49:04.665624 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.665625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.665637 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.665666 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.666033 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49558: BlockingRecv error: recv got EOF from 127.0.0.1:49558 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260619 02:49:04.700464 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.699433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49562 (local address 127.12.145.125:34201)
0619 02:49:04.699479 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.699481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.699786 (+ 305us) server_negotiation.cc:407] Connection header received
0619 02:49:04.699914 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.699916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.699927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.699959 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.700404 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49562: BlockingRecv error: recv got EOF from 127.0.0.1:49562 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260619 02:49:04.766578 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.765796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49568 (local address 127.12.145.125:34201)
0619 02:49:04.765867 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.765869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.765987 (+ 118us) server_negotiation.cc:407] Connection header received
0619 02:49:04.766030 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.766031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.766041 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.766094 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.766471 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49568: BlockingRecv error: recv got EOF from 127.0.0.1:49568 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260619 02:49:04.896490 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:04.895680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49584 (local address 127.12.145.125:34201)
0619 02:49:04.895751 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:04.895754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:04.895878 (+ 124us) server_negotiation.cc:407] Connection header received
0619 02:49:04.895933 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:04.895934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:04.895945 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:04.896054 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:04.896418 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49584: BlockingRecv error: recv got EOF from 127.0.0.1:49584 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260619 02:49:05.154672 2770 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:05.153779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49596 (local address 127.12.145.125:34201)
0619 02:49:05.153838 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:05.153840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:05.153951 (+ 111us) server_negotiation.cc:407] Connection header received
0619 02:49:05.154089 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:05.154090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:05.154117 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:05.154190 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:05.154609 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49596: BlockingRecv error: recv got EOF from 127.0.0.1:49596 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260619 02:49:05.530525 2874 catalog_manager.cc:1259] Loaded cluster ID: 060b37a460284f5193cb618953408ab6
I20260619 02:49:05.530612 2874 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: loading cluster ID for follower catalog manager: success
I20260619 02:49:05.531436 2874 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: acquiring CA information for follower catalog manager: success
I20260619 02:49:05.531754 2874 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9eaadf3ac8b9422d83783e82830157c4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 02:49:05.596094 2907 catalog_manager.cc:1259] Loaded cluster ID: 060b37a460284f5193cb618953408ab6
I20260619 02:49:05.596166 2907 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: loading cluster ID for follower catalog manager: success
I20260619 02:49:05.597046 2907 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: acquiring CA information for follower catalog manager: success
I20260619 02:49:05.597316 2907 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5afed2baf0e44cae89fff6354d07cf48: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 02:49:05.670246 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:05.667754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49606 (local address 127.12.145.125:34201)
0619 02:49:05.667918 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:05.667920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:05.667931 (+ 11us) server_negotiation.cc:407] Connection header received
0619 02:49:05.667957 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:05.667958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:05.668007 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:05.668080 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:05.668219 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.668727 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.669572 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.669766 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.669824 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:05.669977 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:05.670079 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:05.670135 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:05.670166 (+ 31us) server_negotiation.cc:299] Negotiation successful
0619 02:49:05.670182 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":80,"threads_started":1}
I20260619 02:49:05.674360 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:05.672031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42234 (local address 127.12.145.124:36719)
0619 02:49:05.672140 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:05.672142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:05.672150 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:49:05.672191 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:05.672192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:05.672224 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:05.672288 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:05.672366 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.672823 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.673548 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.673797 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.673890 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:05.674056 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:05.674144 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:05.674200 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:05.674236 (+ 36us) server_negotiation.cc:299] Negotiation successful
0619 02:49:05.674252 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":58,"threads_started":1}
I20260619 02:49:05.678920 2988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:05.675975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54746 (local address 127.12.145.126:33495)
0619 02:49:05.676096 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:05.676097 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:05.676277 (+ 180us) server_negotiation.cc:407] Connection header received
0619 02:49:05.676325 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:05.676326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:05.676380 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:05.676451 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:05.676569 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.677315 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.678034 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.678312 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.678376 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:05.678568 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:05.678667 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:05.678729 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:05.678794 (+ 65us) server_negotiation.cc:299] Negotiation successful
0619 02:49:05.678817 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":52,"threads_started":1}
I20260619 02:49:05.678966 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:05.676268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42240 (local address 127.12.145.124:36719)
0619 02:49:05.676306 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:05.676307 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:05.676332 (+ 25us) server_negotiation.cc:407] Connection header received
0619 02:49:05.676390 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:05.676391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:05.676400 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:05.676467 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:05.676634 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.677082 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.678147 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.678419 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.678467 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:05.678683 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:05.678715 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:05.678746 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:05.678857 (+ 111us) server_negotiation.cc:299] Negotiation successful
0619 02:49:05.678881 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:49:05.679073 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:05.676030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49622 (local address 127.12.145.125:34201)
0619 02:49:05.676068 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:05.676070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:05.676205 (+ 135us) server_negotiation.cc:407] Connection header received
0619 02:49:05.676304 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:05.676305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:05.676317 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:05.676346 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:05.676537 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.677249 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.678211 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:05.678534 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:05.678621 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:05.678771 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:05.678806 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:05.678836 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:05.678963 (+ 127us) server_negotiation.cc:299] Negotiation successful
0619 02:49:05.678987 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260619 02:49:05.680984 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2623
I20260619 02:49:05.686532 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2698
I20260619 02:49:05.692212 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 2773
2026-06-19T02:49:05Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2798 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 02:49:05 dist-test-slave-fbl4 krb5kdc[2994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 02:49:05 dist-test-slave-fbl4 krb5kdc[2994](info): set up 2 sockets
Jun 19 02:49:05 dist-test-slave-fbl4 krb5kdc[2994](info): commencing operation
krb5kdc: starting...
W20260619 02:49:06.726876 12869 mini_kdc.cc:121] Time spent starting KDC: real 1.015s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/test-user.keytab.
Jun 19 02:49:06 dist-test-slave-fbl4 krb5kdc[2994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T02:49:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T02:49:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.145.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
Entry for principal kudu/127.12.145.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab.
I20260619 02:49:06.841544 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:35895
--webserver_interface=127.12.145.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:35895,127.12.145.125:40661,127.12.145.124:46693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 02:49:06.922828 3007 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 02:49:06.923065 3007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:06.923095 3007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:06.923141 3007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:06.924299 3007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:06.924364 3007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:06.924400 3007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:06.924432 3007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:06.924463 3007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:06.925910 3007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:35895,127.12.145.125:40661,127.12.145.124:46693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.126.keytab
--principal=kudu/127.12.145.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.126:35895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.145.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:06.926183 3007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:06.926415 3007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:06.931191 3015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:06.931195 3012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:06.931320 3007 server_base.cc:1034] running on GCE node
W20260619 02:49:06.931180 3013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:06.931695 3007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:06.932008 3007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:06.933171 3007 hybrid_clock.cc:648] HybridClock initialized: now 1781837346933155 us; error 27 us; skew 500 ppm
Jun 19 02:49:06 dist-test-slave-fbl4 krb5kdc[2994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:06.935827 3007 init.cc:377] Logged in from keytab as kudu/127.12.145.126@KRBTEST.COM (short username kudu)
I20260619 02:49:06.936213 3007 webserver.cc:460] Webserver started at http://127.12.145.126:45577/ using document root <none> and password file <none>
I20260619 02:49:06.936388 3007 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:06.936429 3007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:06.936514 3007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:06.937556 3007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data/instance:
uuid: "8ac53a62b8c24a05a22e17ba6afb3816"
format_stamp: "Formatted at 2026-06-19 02:49:06 on dist-test-slave-fbl4"
server_key: "1455cb289f7be55cb10f37d1c352ef70"
server_key_iv: "c100a2a0a883d4da4f4734deeaae9292"
server_key_version: "encryptionkey@0"
I20260619 02:49:06.937879 3007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/wal/instance:
uuid: "8ac53a62b8c24a05a22e17ba6afb3816"
format_stamp: "Formatted at 2026-06-19 02:49:06 on dist-test-slave-fbl4"
server_key: "1455cb289f7be55cb10f37d1c352ef70"
server_key_iv: "c100a2a0a883d4da4f4734deeaae9292"
server_key_version: "encryptionkey@0"
I20260619 02:49:06.939244 3007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:49:06.939895 3022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:06.940099 3007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:49:06.940187 3007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/wal
uuid: "8ac53a62b8c24a05a22e17ba6afb3816"
format_stamp: "Formatted at 2026-06-19 02:49:06 on dist-test-slave-fbl4"
server_key: "1455cb289f7be55cb10f37d1c352ef70"
server_key_iv: "c100a2a0a883d4da4f4734deeaae9292"
server_key_version: "encryptionkey@0"
I20260619 02:49:06.940258 3007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:06.950855 3007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:06.953063 3007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:06.953217 3007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:06.956996 3007 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.126:35895
I20260619 02:49:06.957070 3074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.126:35895 every 8 connection(s)
I20260619 02:49:06.957382 3007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/data/info.pb
I20260619 02:49:06.958254 3075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:06.959754 3075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:49:06 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:06.965710 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 3007
I20260619 02:49:06.965822 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-0/wal/instance
I20260619 02:49:06.966051 12869 external_mini_cluster.cc:1428] Setting key 3e7fe102b551cf769b251dfbe978c55a
I20260619 02:49:06.968936 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:06.960351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35895 (local address 127.0.0.1:58782)
0619 02:49:06.960576 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:06.960602 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:06.961013 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:06.961249 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:06.961251 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:06.961483 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:06.961622 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:06.961625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:06.962540 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:06.962541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:06.963249 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:06.963251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:06.963687 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:06.963688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:06.963740 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:06.964159 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:06.964167 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:06.965518 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:06.967431 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:06.967437 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:06.967439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:06.967628 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:06.967894 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:06.967894 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:06.967895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:06.967990 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:06.968346 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:06.968350 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:06.968409 (+ 59us) client_negotiation.cc:769] Sending connection context
0619 02:49:06.968512 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 02:49:06.968740 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":94,"thread_start_us":89,"threads_started":1}
I20260619 02:49:06.968945 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:06.960379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58782 (local address 127.12.145.126:35895)
0619 02:49:06.960524 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:06.960531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:06.960678 (+ 147us) server_negotiation.cc:407] Connection header received
0619 02:49:06.961131 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:06.961133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:06.961148 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:06.961225 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:06.961698 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:06.962459 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:06.963321 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:06.963614 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:06.963692 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:06.965616 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:06.965624 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:06.965625 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:06.965632 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:06.967327 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:06.967722 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:06.967725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:06.967726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:06.967803 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:06.968064 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:06.968065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:06.968066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:06.968265 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:06.968352 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:06.968543 (+ 191us) server_negotiation.cc:299] Negotiation successful
0619 02:49:06.968695 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260619 02:49:06.969614 3075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:06.969986 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:06.969880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50884)
0619 02:49:06.969928 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:06.969970 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260619 02:49:06.970106 3023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
I20260619 02:49:06.970501 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:06.970412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50894)
0619 02:49:06.970459 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:06.970482 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 02:49:06.970633 3075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:40661: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.145.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab.
Entry for principal kudu/127.12.145.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab.
I20260619 02:49:06.988989 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:40661
--webserver_interface=127.12.145.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab
--principal=kudu/127.12.145.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:35895,127.12.145.125:40661,127.12.145.124:46693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:49:07.019856 3075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } attempt: 1
I20260619 02:49:07.020351 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.020217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50896)
0619 02:49:07.020284 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.020322 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260619 02:49:07.020745 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.020649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50912)
0619 02:49:07.020693 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.020718 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260619 02:49:07.020833 3075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:40661: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
W20260619 02:49:07.069003 3082 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 02:49:07.069279 3082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:07.069308 3082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:07.069352 3082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:07.070521 3082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:07.070605 3082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:07.070629 3082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:07.070649 3082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:07.070678 3082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:07.072113 3082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:35895,127.12.145.125:40661,127.12.145.124:46693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.125.keytab
--principal=kudu/127.12.145.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.125:40661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.145.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:07.072386 3082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:07.072628 3082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:07.077401 3087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:07.077407 3090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:07.077420 3088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:07.077813 3082 server_base.cc:1034] running on GCE node
I20260619 02:49:07.078054 3082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:07.078374 3082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:07.079533 3082 hybrid_clock.cc:648] HybridClock initialized: now 1781837347079509 us; error 40 us; skew 500 ppm
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:07.081988 3082 init.cc:377] Logged in from keytab as kudu/127.12.145.125@KRBTEST.COM (short username kudu)
I20260619 02:49:07.082428 3082 webserver.cc:460] Webserver started at http://127.12.145.125:35399/ using document root <none> and password file <none>
I20260619 02:49:07.082690 3082 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:07.082736 3082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:07.082826 3082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:07.083894 3082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data/instance:
uuid: "6d7289e6f5dd4d74801fd6e956469b14"
format_stamp: "Formatted at 2026-06-19 02:49:07 on dist-test-slave-fbl4"
server_key: "dc8d26578b1b504b5b8d4ab03c860e9b"
server_key_iv: "e59ee2d44466aa5b0f78222383cd6001"
server_key_version: "encryptionkey@0"
I20260619 02:49:07.084195 3082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/wal/instance:
uuid: "6d7289e6f5dd4d74801fd6e956469b14"
format_stamp: "Formatted at 2026-06-19 02:49:07 on dist-test-slave-fbl4"
server_key: "dc8d26578b1b504b5b8d4ab03c860e9b"
server_key_iv: "e59ee2d44466aa5b0f78222383cd6001"
server_key_version: "encryptionkey@0"
I20260619 02:49:07.085458 3082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260619 02:49:07.086189 3097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:07.086397 3082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 02:49:07.086508 3082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/wal
uuid: "6d7289e6f5dd4d74801fd6e956469b14"
format_stamp: "Formatted at 2026-06-19 02:49:07 on dist-test-slave-fbl4"
server_key: "dc8d26578b1b504b5b8d4ab03c860e9b"
server_key_iv: "e59ee2d44466aa5b0f78222383cd6001"
server_key_version: "encryptionkey@0"
I20260619 02:49:07.086606 3082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:07.088968 3075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } attempt: 2
I20260619 02:49:07.089385 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.089249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50928)
0619 02:49:07.089317 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.089358 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260619 02:49:07.089726 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.089666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50934)
0619 02:49:07.089691 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.089712 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260619 02:49:07.089845 3075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.125:40661: Network error: Client connection negotiation failed: client connection to 127.12.145.125:40661: connect: Connection refused (error 111)
I20260619 02:49:07.098307 3082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:07.100548 3082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 02:49:07.100700 3082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:07.104497 3082 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.125:40661
I20260619 02:49:07.104527 3149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.125:40661 every 8 connection(s)
I20260619 02:49:07.104882 3082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/data/info.pb
I20260619 02:49:07.105744 3150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:07.107328 3150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:07.113372 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 3082
I20260619 02:49:07.113448 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-1/wal/instance
I20260619 02:49:07.113646 12869 external_mini_cluster.cc:1428] Setting key f6a70c7da1317a6171a7609a16ac24b1
I20260619 02:49:07.116165 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.108031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58784 (local address 127.12.145.126:35895)
0619 02:49:07.108100 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.108102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.108290 (+ 188us) server_negotiation.cc:407] Connection header received
0619 02:49:07.108791 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.108792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.108805 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.108900 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.109459 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.109923 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.110946 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.111139 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.111196 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.113095 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.113096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.113097 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.113103 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.114759 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.115198 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.115200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.115200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.115260 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.115521 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.115522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.115522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.115636 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.115710 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.115990 (+ 280us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.116076 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260619 02:49:07.116325 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.108001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35895 (local address 127.0.0.1:58784)
0619 02:49:07.108160 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.108200 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.108634 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.108946 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.108949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.109175 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.109357 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.109360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.110009 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.110009 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.110849 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.110852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.111225 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.111225 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.111324 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.111714 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.111721 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.113016 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.114861 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.114868 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.114870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.115103 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.115330 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.115331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.115331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.115443 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.115703 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.115710 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.115844 (+ 134us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.115949 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.116099 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260619 02:49:07.116847 3150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.145.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.145.124@KRBTEST.COM" created.
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:49:07.128084 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.117094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50944)
0619 02:49:07.117141 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.117151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.117189 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.117457 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.117457 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.117567 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.117612 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.117613 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.118965 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.118965 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.119455 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.119456 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.120221 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.120222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.120283 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.121278 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.121284 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.124894 (+ 3610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.126969 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.126970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.126971 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.127135 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.127358 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.127358 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.127359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.127411 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.127756 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.127757 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.127793 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.127853 (+ 60us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.127950 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260619 02:49:07.128149 3154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.117149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.12.145.125:40661)
0619 02:49:07.117301 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.117306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.117329 (+ 23us) server_negotiation.cc:407] Connection header received
0619 02:49:07.117352 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.117354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.117367 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.117449 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.117686 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.118866 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.119536 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.120075 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.120143 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.124989 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.124999 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.124999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.125006 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.126861 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.127238 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.127241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.127241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.127293 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.127496 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.127497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.127497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.127688 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.127764 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.127879 (+ 115us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.128007 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260619 02:49:07.128705 3150 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:07.129082 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.128936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36382)
0619 02:49:07.128991 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.129046 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260619 02:49:07.129288 3100 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
I20260619 02:49:07.129694 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.129556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36392)
0619 02:49:07.129617 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.129667 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260619 02:49:07.129827 3150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:46693: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.145.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab.
Entry for principal kudu/127.12.145.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab.
I20260619 02:49:07.139568 12869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskus8Nkk/build/release/bin/kudu
/tmp/dist-test-taskus8Nkk/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:46693
--webserver_interface=127.12.145.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab
--principal=kudu/127.12.145.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.145.84:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.145.126:35895,127.12.145.125:40661,127.12.145.124:46693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 02:49:07.179067 3150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } attempt: 1
I20260619 02:49:07.179617 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.179477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36396)
0619 02:49:07.179536 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.179584 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260619 02:49:07.180040 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.179924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36398)
0619 02:49:07.179993 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.180021 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260619 02:49:07.180207 3150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:46693: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
I20260619 02:49:07.181015 3075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } attempt: 3
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:49:07.187747 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.181304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50956)
0619 02:49:07.181357 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.181368 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.181423 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.181539 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.181540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.181704 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.181768 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.181770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.182417 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.182419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.183057 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.183060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.183467 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.183468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.183545 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.184006 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.184011 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.185153 (+ 1142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.186882 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.186883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.186883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.187043 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.187232 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.187232 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.187232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.187282 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.187522 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.187523 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.187560 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.187612 (+ 52us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.187684 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260619 02:49:07.187804 3154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.181356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50956 (local address 127.12.145.125:40661)
0619 02:49:07.181415 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.181417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.181444 (+ 27us) server_negotiation.cc:407] Connection header received
0619 02:49:07.181473 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.181475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.181487 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.181537 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.181846 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.182335 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.183151 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.183377 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.183467 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.185240 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.185242 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.185243 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.185249 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.186807 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.187111 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.187112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.187113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.187171 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.187336 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.187337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.187338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.187464 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.187527 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.187648 (+ 121us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.187723 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260619 02:49:07.188124 3075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:07.188475 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.188375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36406)
0619 02:49:07.188418 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.188455 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260619 02:49:07.188809 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.188706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36420)
0619 02:49:07.188749 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.188789 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260619 02:49:07.188930 3075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:46693: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
I20260619 02:49:07.220088 3075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } attempt: 1
I20260619 02:49:07.220582 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.220436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36432)
0619 02:49:07.220502 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.220546 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260619 02:49:07.220932 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.220834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36442)
0619 02:49:07.220880 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.220911 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260619 02:49:07.221033 3075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:46693: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
W20260619 02:49:07.220845 3157 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 02:49:07.221091 3157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 02:49:07.221125 3157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 02:49:07.221153 3157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 02:49:07.222261 3157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 02:49:07.222298 3157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 02:49:07.222312 3157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 02:49:07.222357 3157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 02:49:07.222383 3157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 02:49:07.223958 3157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.145.84:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.145.126:35895,127.12.145.125:40661,127.12.145.124:46693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/krb5kdc/kudu_127.12.145.124.keytab
--principal=kudu/127.12.145.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.145.124:46693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.145.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 19 Jun 2026 01:53:23 UTC on ccycloud.quasar-wqwdzy.root.comops.site
build id 4454976
I20260619 02:49:07.224198 3157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 02:49:07.224431 3157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 02:49:07.229108 3163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:07.229146 3162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 02:49:07.229091 3165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 02:49:07.229312 3157 server_base.cc:1034] running on GCE node
I20260619 02:49:07.229526 3157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 02:49:07.229799 3157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 02:49:07.230975 3157 hybrid_clock.cc:648] HybridClock initialized: now 1781837347230948 us; error 39 us; skew 500 ppm
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 02:49:07.233399 3157 init.cc:377] Logged in from keytab as kudu/127.12.145.124@KRBTEST.COM (short username kudu)
I20260619 02:49:07.233780 3157 webserver.cc:460] Webserver started at http://127.12.145.124:43049/ using document root <none> and password file <none>
I20260619 02:49:07.233968 3157 fs_manager.cc:359] Metadata directory not provided
I20260619 02:49:07.234009 3157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 02:49:07.234095 3157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 02:49:07.235152 3157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data/instance:
uuid: "342a8852271b45719db80d8230914d8c"
format_stamp: "Formatted at 2026-06-19 02:49:07 on dist-test-slave-fbl4"
server_key: "b4544e223124c78e6f8dbb12ec68dc90"
server_key_iv: "4eadc358b06f4f3cdaff0cb06a382ed7"
server_key_version: "encryptionkey@0"
I20260619 02:49:07.235479 3157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/wal/instance:
uuid: "342a8852271b45719db80d8230914d8c"
format_stamp: "Formatted at 2026-06-19 02:49:07 on dist-test-slave-fbl4"
server_key: "b4544e223124c78e6f8dbb12ec68dc90"
server_key_iv: "4eadc358b06f4f3cdaff0cb06a382ed7"
server_key_version: "encryptionkey@0"
I20260619 02:49:07.236711 3157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260619 02:49:07.237382 3172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 02:49:07.237561 3157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260619 02:49:07.237645 3157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data,/tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/wal
uuid: "342a8852271b45719db80d8230914d8c"
format_stamp: "Formatted at 2026-06-19 02:49:07 on dist-test-slave-fbl4"
server_key: "b4544e223124c78e6f8dbb12ec68dc90"
server_key_iv: "4eadc358b06f4f3cdaff0cb06a382ed7"
server_key_version: "encryptionkey@0"
I20260619 02:49:07.237696 3157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 02:49:07.247117 3157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 02:49:07.248380 3150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } attempt: 2
I20260619 02:49:07.248819 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.248692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36458)
0619 02:49:07.248754 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.248788 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260619 02:49:07.249194 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.249109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36468)
0619 02:49:07.249152 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.249176 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260619 02:49:07.249226 3157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
W20260619 02:49:07.249307 3150 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.145.124:46693: Network error: Client connection negotiation failed: client connection to 127.12.145.124:46693: connect: Connection refused (error 111)
I20260619 02:49:07.249392 3157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 02:49:07.253085 3157 rpc_server.cc:307] RPC server started. Bound to: 127.12.145.124:46693
I20260619 02:49:07.253151 3224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.145.124:46693 every 8 connection(s)
I20260619 02:49:07.253468 3157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/data/info.pb
I20260619 02:49:07.253787 12869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskus8Nkk/build/release/bin/kudu as pid 3157
I20260619 02:49:07.253917 12869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskus8Nkk/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781837054956172-12869-0/minicluster-data/master-2/wal/instance
I20260619 02:49:07.254138 12869 external_mini_cluster.cc:1428] Setting key 9e7e64081b0eeda445a79138c642f6ba
I20260619 02:49:07.254485 3225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 02:49:07.256440 3225 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:07.264359 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.257072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.12.145.126:35895)
0619 02:49:07.257138 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.257140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.257252 (+ 112us) server_negotiation.cc:407] Connection header received
0619 02:49:07.257354 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.257355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.257366 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.257436 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.257856 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.258321 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.259250 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.259559 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.259641 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.261664 (+ 2023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.261666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.261666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.261672 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.263168 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.263504 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.263505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.263506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.263560 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.263786 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.263787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.263788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.263904 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.263985 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.264165 (+ 180us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.264244 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260619 02:49:07.264478 3228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.254632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36478 (local address 127.12.145.124:46693)
0619 02:49:07.254809 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.254819 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.254851 (+ 32us) server_negotiation.cc:407] Connection header received
0619 02:49:07.255532 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.255540 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.255588 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.255752 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.256385 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.257482 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.258238 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.258707 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.258833 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.261207 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.261214 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.261215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.261222 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.263074 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.263415 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.263420 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.263421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.263506 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.263715 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.263715 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.263716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.263905 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.264046 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.264140 (+ 94us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.264275 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260619 02:49:07.264602 3229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.257006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.126:35895 (local address 127.0.0.1:58786)
0619 02:49:07.257152 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.257191 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.257269 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.257466 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.257469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.257704 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.257767 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.257769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.258407 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.258408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.259128 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.259130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.259645 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.259646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.259704 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.260133 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.260141 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.261574 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.263233 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.263238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.263240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.263420 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.263633 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.263635 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.263635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.263719 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.263975 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.263981 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.264049 (+ 68us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.264142 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.264452 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":151,"thread_start_us":74,"threads_started":1}
I20260619 02:49:07.265035 3225 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.126@KRBTEST.COM
I20260619 02:49:07.271989 3154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.265409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50962 (local address 127.12.145.125:40661)
0619 02:49:07.265461 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.265463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.265471 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:49:07.265497 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.265498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.265506 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.265568 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.265826 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.266271 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.267007 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.267215 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.267295 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.269260 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.269261 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.269262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.269269 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.270831 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.271190 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.271191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.271191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.271244 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.271477 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.271478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.271478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.271618 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.271684 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.271823 (+ 139us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.271900 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260619 02:49:07.271999 3229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.265346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.125:40661 (local address 127.0.0.1:50962)
0619 02:49:07.265374 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.265384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.265420 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.265577 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.265578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.265706 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.265749 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.265750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.266349 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.266350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.266910 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.266912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.267295 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.267296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.267363 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.267689 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.267692 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.269181 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.270905 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.270906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.270907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.271123 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.271316 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.271317 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.271317 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.271391 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.271683 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.271684 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.271723 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.271795 (+ 72us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.271873 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260619 02:49:07.272593 3225 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } has no permanent_uuid. Determining permanent_uuid...
I20260619 02:49:07.272780 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.265266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58800 (local address 127.12.145.126:35895)
0619 02:49:07.265301 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.265303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.265328 (+ 25us) server_negotiation.cc:407] Connection header received
0619 02:49:07.265425 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.265426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.265435 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.265485 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.265925 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.266347 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.267062 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.267240 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.267317 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.269370 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.269372 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.269372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.269378 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.271009 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.271375 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.271376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.271376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.271433 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.271615 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.271615 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.271615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.271740 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.272565 (+ 825us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.272608 (+ 43us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.272690 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.124@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.145.125@KRBTEST.COM
I20260619 02:49:07.278965 3229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.272817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36480)
0619 02:49:07.272870 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.272879 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.272918 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.273042 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.273043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.273183 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.273235 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.273236 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.273883 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.273884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.274339 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.274341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.274797 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.274797 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.274845 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.275228 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.275231 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.276438 (+ 1207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.277912 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.277912 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.277913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.278118 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.278302 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.278303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.278303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.278379 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.278664 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.278665 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.278710 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.278780 (+ 70us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.278880 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260619 02:49:07.279093 3228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.272873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36480 (local address 127.12.145.124:46693)
0619 02:49:07.272905 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.272906 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.272914 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:49:07.272980 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.272980 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.272988 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.273039 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.273325 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.273790 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.274436 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.274715 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.274796 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.276528 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.276529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.276530 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.276535 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.277823 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.278192 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.278193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.278193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.278240 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.278437 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.278438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.278438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.278602 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.278662 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.278799 (+ 137us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.278955 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":18}
I20260619 02:49:07.280718 3225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: Bootstrap starting.
I20260619 02:49:07.280992 3154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.273371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50972 (local address 127.12.145.125:40661)
0619 02:49:07.273410 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.273412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.273421 (+ 9us) server_negotiation.cc:407] Connection header received
0619 02:49:07.273440 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.273441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.273456 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.273502 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.274050 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.274478 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.275230 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.275547 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.275618 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.278076 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.278077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.278078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.278085 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.279781 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.280131 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.280131 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.280131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.280186 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.280437 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.280439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.280439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.280544 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.280667 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.280758 (+ 91us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.280924 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:49:07.281814 3225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:07.282109 3225 log.cc:824] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:07.282645 12869 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 02:49:07.283641 3225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: No bootstrap required, opened a new log
I20260619 02:49:07.283483 3049 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8ac53a62b8c24a05a22e17ba6afb3816"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58800
I20260619 02:49:07.285056 3225 raft_consensus.cc:348] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.285171 3225 raft_consensus.cc:729] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342a8852271b45719db80d8230914d8c, State: Initialized, Role: FOLLOWER
I20260619 02:49:07.285259 3225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.285599 3225 sys_catalog.cc:564] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:07.285596 3231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.285751 3231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [sys.catalog]: This master's current role is: FOLLOWER
W20260619 02:49:07.287283 3242 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:49:07.287338 3242 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:49:07.287621 3157 master_runner.cc:186] Error getting master registration for 127.12.145.126:35895: OK, instance_id { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" instance_seqno: 1781837346955945 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 02:49:07.290421 3157 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 02:49:07.296159 3075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } attempt: 2
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837346, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.126@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
I20260619 02:49:07.303179 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.296419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36490)
0619 02:49:07.296476 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.296487 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.296531 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.296716 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.296717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.296928 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.296976 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.296977 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.297874 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.297875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.298378 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.298379 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.298825 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.298825 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.298884 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.299317 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.299322 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.300621 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.302160 (+ 1539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.302161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.302161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.302325 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.302526 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.302527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.302528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.302604 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.302860 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.302862 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.302905 (+ 43us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.302994 (+ 89us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.303090 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260619 02:49:07.303179 3228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.296487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36490 (local address 127.12.145.124:46693)
0619 02:49:07.296555 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.296558 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.296565 (+ 7us) server_negotiation.cc:407] Connection header received
0619 02:49:07.296622 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.296623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.296632 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.296712 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.297044 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.297764 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.298476 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.298752 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.298827 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.300714 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.300715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.300715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.300722 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.302062 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.302403 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.302404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.302404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.302461 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.302659 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.302660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.302660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.302786 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.302857 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.303016 (+ 159us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.303089 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260619 02:49:07.304813 3075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816: Bootstrap starting.
I20260619 02:49:07.305542 3075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:07.305833 3075 log.cc:824] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:07.306632 3075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816: No bootstrap required, opened a new log
I20260619 02:49:07.307621 3075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.307747 3075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac53a62b8c24a05a22e17ba6afb3816, State: Initialized, Role: FOLLOWER
I20260619 02:49:07.307834 3075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.308130 3075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:07.308152 3049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 02:49:07.308197 3049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:49:07.309015 3049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.310074 3199 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "342a8852271b45719db80d8230914d8c"
I20260619 02:49:07.310210 3199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [term 0 FOLLOWER]: Advancing to term 1
W20260619 02:49:07.310278 3256 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 02:49:07.310317 3256 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:49:07.308101 3245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.310873 3245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:07.311193 3199 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ac53a62b8c24a05a22e17ba6afb3816 in term 1.
I20260619 02:49:07.311414 3025 leader_election.cc:302] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342a8852271b45719db80d8230914d8c, 8ac53a62b8c24a05a22e17ba6afb3816; no voters:
I20260619 02:49:07.311528 3245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 02:49:07.311661 3245 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [term 1 LEADER]: Becoming Leader. State: Replica: 8ac53a62b8c24a05a22e17ba6afb3816, State: Running, Role: LEADER
I20260619 02:49:07.311746 3245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.312191 3245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ac53a62b8c24a05a22e17ba6afb3816. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.312287 3245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:07.312453 3260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 02:49:07.312638 3260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 02:49:07.310657 3007 master_runner.cc:186] Error getting master registration for 127.12.145.125:40661: OK, instance_id { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" instance_seqno: 1781837347103443 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 02:49:07.312795 3007 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 02:49:07.309508 3049 leader_election.cc:288] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [CANDIDATE]: Term 1 election: Requested vote from peers 6d7289e6f5dd4d74801fd6e956469b14 (127.12.145.125:40661), 342a8852271b45719db80d8230914d8c (127.12.145.124:46693)
I20260619 02:49:07.314319 3199 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [term 1 FOLLOWER]: Refusing update from remote peer 8ac53a62b8c24a05a22e17ba6afb3816: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:49:07.315074 3258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:49:07.316344 3231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ac53a62b8c24a05a22e17ba6afb3816. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.316433 3231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:07.317535 3245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.317616 3245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:07.318068 3231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.318146 3231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:07.327270 3260 catalog_manager.cc:1347] Generated new cluster ID: ce166d29c6824cdbb61cdb3e141d26dd
I20260619 02:49:07.327328 3260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 02:49:07.327617 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.319021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58802 (local address 127.12.145.126:35895)
0619 02:49:07.319057 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.319059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.320008 (+ 949us) server_negotiation.cc:407] Connection header received
0619 02:49:07.320097 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.320098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.320108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.320138 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.320840 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.321550 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.322616 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.322915 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.322952 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.324515 (+ 1563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.324516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.324516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.324523 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.326138 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.326562 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.326564 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.326565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.326624 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.327013 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.327014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.327015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.327141 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.327227 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.327459 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.327533 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260619 02:49:07.328842 3228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.318820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36502 (local address 127.12.145.124:46693)
0619 02:49:07.318867 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.318868 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.318965 (+ 97us) server_negotiation.cc:407] Connection header received
0619 02:49:07.319087 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.319088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.319101 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.319195 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.319926 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.320654 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.322447 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.322780 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.322822 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.325363 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.325364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.325364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.325371 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.327025 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.327675 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.327676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.327677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.327743 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.328108 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.328109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.328109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.328243 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.328306 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.328664 (+ 358us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.328736 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260619 02:49:07.334520 3154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.326743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50978 (local address 127.12.145.125:40661)
0619 02:49:07.326803 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.326805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.327873 (+ 1068us) server_negotiation.cc:407] Connection header received
0619 02:49:07.327963 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.327964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.327974 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.328002 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.328468 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.329147 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.330035 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.330351 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.330419 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.331628 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.331630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.331630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.331637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.333424 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.333745 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.333746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.333746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.333813 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.334028 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.334029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.334029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.334158 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.334267 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.334362 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.334431 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260619 02:49:07.340525 3150 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } attempt: 3
Jun 19 02:49:07 dist-test-slave-fbl4 krb5kdc[2994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781837347, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.145.125@KRBTEST.COM for kudu/127.12.145.124@KRBTEST.COM
I20260619 02:49:07.350293 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.340929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.145.124:46693 (local address 127.0.0.1:36516)
0619 02:49:07.341009 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0619 02:49:07.341019 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0619 02:49:07.341073 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 02:49:07.341268 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 02:49:07.341269 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 02:49:07.341427 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0619 02:49:07.341463 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.341465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.342632 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.342633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.343463 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 02:49:07.343465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.344020 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.344021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 02:49:07.344094 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.344558 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 02:49:07.344563 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 02:49:07.346117 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 02:49:07.349001 (+ 2884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.349003 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.349003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.349202 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.349515 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 02:49:07.349516 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 02:49:07.349516 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0619 02:49:07.349584 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 02:49:07.350008 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 02:49:07.350009 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 02:49:07.350062 (+ 53us) client_negotiation.cc:769] Sending connection context
0619 02:49:07.350108 (+ 46us) client_negotiation.cc:240] Negotiation successful
0619 02:49:07.350195 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260619 02:49:07.351133 3228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:07.341023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36516 (local address 127.12.145.124:46693)
0619 02:49:07.341088 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.341090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.341098 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:49:07.341146 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.341147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.341155 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.341209 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.341679 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.342480 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.343607 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:07.343894 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:07.343947 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:07.346222 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 02:49:07.346223 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 02:49:07.346223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 02:49:07.346230 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0619 02:49:07.348837 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.349337 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.349338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.349338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.349418 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 02:49:07.349666 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 02:49:07.349666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 02:49:07.349667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 02:49:07.349903 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 02:49:07.350747 (+ 844us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:07.350819 (+ 72us) server_negotiation.cc:299] Negotiation successful
0619 02:49:07.350959 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260619 02:49:07.352813 3150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: Bootstrap starting.
I20260619 02:49:07.353546 3150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: Neither blocks nor log segments found. Creating new log.
I20260619 02:49:07.353833 3150 log.cc:824] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: Log is configured to *not* fsync() on all Append() calls
I20260619 02:49:07.355063 3150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: No bootstrap required, opened a new log
I20260619 02:49:07.357038 3150 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.357168 3150 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d7289e6f5dd4d74801fd6e956469b14, State: Initialized, Role: FOLLOWER
I20260619 02:49:07.357239 3150 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } }
I20260619 02:49:07.357519 3150 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 02:49:07.358646 3123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [term 0 FOLLOWER]: Advancing to term 1
I20260619 02:49:07.358743 3260 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 02:49:07.359401 3260 catalog_manager.cc:1504] Loading token signing keys...
I20260619 02:49:07.359444 3123 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [term 1 FOLLOWER]: Refusing update from remote peer 8ac53a62b8c24a05a22e17ba6afb3816: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 02:49:07.359601 3124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6d7289e6f5dd4d74801fd6e956469b14"
I20260619 02:49:07.360316 3124 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ac53a62b8c24a05a22e17ba6afb3816 in term 1.
I20260619 02:49:07.360692 3245 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 02:49:07.362635 3275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.363202 3275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:07.363265 3275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ac53a62b8c24a05a22e17ba6afb3816. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.363319 3275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 02:49:07.363344 3275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.363376 3275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14 [sys.catalog]: This master's current role is: FOLLOWER
W20260619 02:49:07.365365 3290 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260619 02:49:07.365411 3260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816: Generated new TSK 0
I20260619 02:49:07.365567 3260 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 02:49:07.365969 3290 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 02:49:07.366147 3258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac53a62b8c24a05a22e17ba6afb3816" member_type: VOTER last_known_addr { host: "127.12.145.126" port: 35895 } } peers { permanent_uuid: "6d7289e6f5dd4d74801fd6e956469b14" member_type: VOTER last_known_addr { host: "127.12.145.125" port: 40661 } } peers { permanent_uuid: "342a8852271b45719db80d8230914d8c" member_type: VOTER last_known_addr { host: "127.12.145.124" port: 46693 } } }
I20260619 02:49:07.366235 3258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac53a62b8c24a05a22e17ba6afb3816 [sys.catalog]: This master's current role is: LEADER
I20260619 02:49:07.366539 3285 mvcc.cc:205] Tried to move back new op lower bound from 7298405774775447552 to 7298405774589804544. Current Snapshot: MvccSnapshot[applied={T|T < 7298405774597124096}]
W20260619 02:49:07.394176 3228 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.392540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36524 (local address 127.12.145.124:46693)
0619 02:49:07.392587 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.392590 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.393509 (+ 919us) server_negotiation.cc:407] Connection header received
0619 02:49:07.393617 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.393618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.393629 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.393660 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.394110 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36524: BlockingRecv error: recv got EOF from 127.0.0.1:36524 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260619 02:49:07.394954 3078 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.392960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.12.145.126:35895)
0619 02:49:07.392999 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.393001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.394417 (+ 1416us) server_negotiation.cc:407] Connection header received
0619 02:49:07.394513 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.394514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.394525 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.394582 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.394888 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58810: BlockingRecv error: recv got EOF from 127.0.0.1:58810 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260619 02:49:07.395678 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.393318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50992 (local address 127.12.145.125:40661)
0619 02:49:07.393362 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.393364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.395171 (+ 1807us) server_negotiation.cc:407] Connection header received
0619 02:49:07.395270 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.395271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.395281 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.395311 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.395621 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50992: BlockingRecv error: recv got EOF from 127.0.0.1:50992 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260619 02:49:07.403959 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.402744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51000 (local address 127.12.145.125:40661)
0619 02:49:07.402795 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.402796 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.403242 (+ 446us) server_negotiation.cc:407] Connection header received
0619 02:49:07.403358 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.403359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.403465 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.403522 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.403910 (+ 388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51000: BlockingRecv error: recv got EOF from 127.0.0.1:51000 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260619 02:49:07.407092 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.406217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51012 (local address 127.12.145.125:40661)
0619 02:49:07.406251 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.406252 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.406474 (+ 222us) server_negotiation.cc:407] Connection header received
0619 02:49:07.406657 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.406658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.406668 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.406699 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.407049 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51012: BlockingRecv error: recv got EOF from 127.0.0.1:51012 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260619 02:49:07.411535 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.410768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51016 (local address 127.12.145.125:40661)
0619 02:49:07.410800 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.410802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.411055 (+ 253us) server_negotiation.cc:407] Connection header received
0619 02:49:07.411148 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.411149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.411159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.411188 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.411497 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51016: BlockingRecv error: recv got EOF from 127.0.0.1:51016 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260619 02:49:07.417398 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.416636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51022 (local address 127.12.145.125:40661)
0619 02:49:07.416670 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.416672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.416922 (+ 250us) server_negotiation.cc:407] Connection header received
0619 02:49:07.417011 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.417012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.417021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.417066 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.417358 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51022: BlockingRecv error: recv got EOF from 127.0.0.1:51022 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260619 02:49:07.427491 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.426687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51036 (local address 127.12.145.125:40661)
0619 02:49:07.426720 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.426722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.426973 (+ 251us) server_negotiation.cc:407] Connection header received
0619 02:49:07.427073 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.427074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.427083 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.427119 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.427443 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51036: BlockingRecv error: recv got EOF from 127.0.0.1:51036 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260619 02:49:07.445595 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.444733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51048 (local address 127.12.145.125:40661)
0619 02:49:07.444784 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.444787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.445037 (+ 250us) server_negotiation.cc:407] Connection header received
0619 02:49:07.445139 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.445140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.445150 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.445180 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.445540 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51048: BlockingRecv error: recv got EOF from 127.0.0.1:51048 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260619 02:49:07.479698 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.478970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51056 (local address 127.12.145.125:40661)
0619 02:49:07.479014 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.479015 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.479141 (+ 126us) server_negotiation.cc:407] Connection header received
0619 02:49:07.479218 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.479219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.479234 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.479304 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.479628 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51056: BlockingRecv error: recv got EOF from 127.0.0.1:51056 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260619 02:49:07.545430 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.544802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51060 (local address 127.12.145.125:40661)
0619 02:49:07.544880 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.544883 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.544974 (+ 91us) server_negotiation.cc:407] Connection header received
0619 02:49:07.545007 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.545008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.545017 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.545082 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.545367 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51060: BlockingRecv error: recv got EOF from 127.0.0.1:51060 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260619 02:49:07.675414 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.674691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51076 (local address 127.12.145.125:40661)
0619 02:49:07.674767 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.674769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.674886 (+ 117us) server_negotiation.cc:407] Connection header received
0619 02:49:07.674933 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.674934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.674945 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.674992 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.675310 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51076: BlockingRecv error: recv got EOF from 127.0.0.1:51076 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260619 02:49:07.933208 3154 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 02:49:07.932484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51082 (local address 127.12.145.125:40661)
0619 02:49:07.932542 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:07.932544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:07.932581 (+ 37us) server_negotiation.cc:407] Connection header received
0619 02:49:07.932676 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:07.932677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:07.932695 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:07.932758 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0619 02:49:07.933141 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51082: BlockingRecv error: recv got EOF from 127.0.0.1:51082 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260619 02:49:08.287787 3242 catalog_manager.cc:1259] Loaded cluster ID: ce166d29c6824cdbb61cdb3e141d26dd
I20260619 02:49:08.287891 3242 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: loading cluster ID for follower catalog manager: success
I20260619 02:49:08.288846 3242 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: acquiring CA information for follower catalog manager: success
I20260619 02:49:08.289250 3242 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 342a8852271b45719db80d8230914d8c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 02:49:08.366447 3290 catalog_manager.cc:1259] Loaded cluster ID: ce166d29c6824cdbb61cdb3e141d26dd
I20260619 02:49:08.366524 3290 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: loading cluster ID for follower catalog manager: success
I20260619 02:49:08.367440 3290 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: acquiring CA information for follower catalog manager: success
I20260619 02:49:08.367802 3290 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6d7289e6f5dd4d74801fd6e956469b14: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 02:49:08.448788 3359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:08.446300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51094 (local address 127.12.145.125:40661)
0619 02:49:08.446416 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:08.446417 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:08.446487 (+ 70us) server_negotiation.cc:407] Connection header received
0619 02:49:08.446592 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:08.446598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:08.446648 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:08.446719 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:08.446882 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.447351 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.448069 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.448243 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.448292 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:08.448504 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:08.448607 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:08.448663 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:08.448707 (+ 44us) server_negotiation.cc:299] Negotiation successful
0619 02:49:08.448722 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":63,"threads_started":1}
I20260619 02:49:08.452806 3365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:08.450604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36528 (local address 127.12.145.124:46693)
0619 02:49:08.450703 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:08.450704 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:08.450712 (+ 8us) server_negotiation.cc:407] Connection header received
0619 02:49:08.450746 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:08.450747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:08.450778 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:08.450844 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:08.450924 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.451379 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.452096 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.452303 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.452361 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:08.452484 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:08.452578 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:08.452633 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:08.452669 (+ 36us) server_negotiation.cc:299] Negotiation successful
0619 02:49:08.452686 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":46,"threads_started":1}
I20260619 02:49:08.457453 3373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:08.454570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58826 (local address 127.12.145.126:35895)
0619 02:49:08.454673 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:08.454675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:08.454700 (+ 25us) server_negotiation.cc:407] Connection header received
0619 02:49:08.454792 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:08.454792 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:08.454842 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:08.454944 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:08.455065 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.455604 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.456424 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.456696 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.456788 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:08.456982 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:08.457084 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:08.457324 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:08.457344 (+ 20us) server_negotiation.cc:299] Negotiation successful
0619 02:49:08.457367 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":52,"threads_started":1}
I20260619 02:49:08.457532 3359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:08.454692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51098 (local address 127.12.145.125:40661)
0619 02:49:08.454736 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:08.454738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:08.454910 (+ 172us) server_negotiation.cc:407] Connection header received
0619 02:49:08.454941 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:08.454943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:08.454954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:08.455011 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:08.455128 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.455594 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.456740 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.457023 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.457105 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:08.457267 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:08.457299 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:08.457347 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:08.457426 (+ 79us) server_negotiation.cc:299] Negotiation successful
0619 02:49:08.457452 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260619 02:49:08.458525 3365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 02:49:08.454735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36532 (local address 127.12.145.124:46693)
0619 02:49:08.454768 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0619 02:49:08.454769 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0619 02:49:08.455020 (+ 251us) server_negotiation.cc:407] Connection header received
0619 02:49:08.455043 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 02:49:08.455044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 02:49:08.455053 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 02:49:08.455133 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 02:49:08.455831 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.456541 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.457646 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 02:49:08.457968 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 02:49:08.458026 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 02:49:08.458169 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 02:49:08.458200 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 02:49:08.458292 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0619 02:49:08.458397 (+ 105us) server_negotiation.cc:299] Negotiation successful
0619 02:49:08.458435 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260619 02:49:08.464641 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 3007
I20260619 02:49:08.469756 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 3082
I20260619 02:49:08.474265 12869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskus8Nkk/build/release/bin/kudu with pid 3157
2026-06-19T02:49:08Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2781 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5580 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (293525 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS